Apr 13 18:50:15 user devstack@n-api.service[61585]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 13 18:50:15 user devstack@n-api.service[61585]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 13 18:50:15 2023] *** Apr 13 18:50:15 user devstack@n-api.service[61585]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 13 18:50:15 user devstack@n-api.service[61585]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 13 18:50:15 user devstack@n-api.service[61585]: nodename: user Apr 13 18:50:15 user devstack@n-api.service[61585]: machine: x86_64 Apr 13 18:50:15 user devstack@n-api.service[61585]: clock source: unix Apr 13 18:50:15 user devstack@n-api.service[61585]: pcre jit disabled Apr 13 18:50:15 user devstack@n-api.service[61585]: detected number of CPU cores: 12 Apr 13 18:50:15 user devstack@n-api.service[61585]: current working directory: / Apr 13 18:50:15 user devstack@n-api.service[61585]: detected binary path: /usr/bin/uwsgi-core Apr 13 18:50:15 user devstack@n-api.service[61585]: your processes number limit is 63637 Apr 13 18:50:15 user devstack@n-api.service[61585]: your memory page size is 4096 bytes Apr 13 18:50:15 user devstack@n-api.service[61585]: detected max file descriptor number: 2048 Apr 13 18:50:16 user devstack@n-api.service[61585]: lock engine: pthread robust mutexes Apr 13 18:50:16 user devstack@n-api.service[61585]: thunder lock: enabled Apr 13 18:50:16 user devstack@n-api.service[61585]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 13 18:50:16 user devstack@n-api.service[61585]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 13 18:50:16 user devstack@n-api.service[61585]: Python main interpreter initialized at 0x560fa6df3990 Apr 13 18:50:16 user devstack@n-api.service[61585]: python threads support enabled Apr 13 18:50:16 user devstack@n-api.service[61585]: your server socket listen backlog is limited to 100 connections Apr 13 18:50:16 user devstack@n-api.service[61585]: your mercy for graceful operations on workers is 90 seconds Apr 13 18:50:16 user devstack@n-api.service[61585]: mapped 537436 bytes (524 KB) for 3 cores Apr 13 18:50:16 user devstack@n-api.service[61585]: *** Operational MODE: preforking *** Apr 13 18:50:16 user devstack@n-api.service[61585]: *** uWSGI is running in multiple interpreter mode *** Apr 13 18:50:16 user devstack@n-api.service[61585]: spawned uWSGI master process (pid: 61585) Apr 13 18:50:16 user devstack@n-api.service[61585]: spawned uWSGI worker 1 (pid: 61587, cores: 1) Apr 13 18:50:16 user devstack@n-api.service[61585]: spawned uWSGI worker 2 (pid: 61588, cores: 1) Apr 13 18:50:16 user devstack@n-api.service[61585]: spawned uWSGI worker 3 (pid: 61589, cores: 1) Apr 13 18:50:16 user devstack@n-api.service[61585]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 13 18:50:16 user devstack@n-api.service[61589]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 18:50:16 user devstack@n-api.service[61588]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 18:50:16 user devstack@n-api.service[61587]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 18:50:20 user devstack@n-api.service[61587]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 18:50:20 user devstack@n-api.service[61587]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 18:50:20 user devstack@n-api.service[61587]: and ``live_migration_inbound_addr`` respectively. Apr 13 18:50:20 user devstack@n-api.service[61587]: ). Its value may be silently ignored in the future. Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 18:50:20 user devstack@n-api.service[61588]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 18:50:20 user devstack@n-api.service[61588]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 18:50:20 user devstack@n-api.service[61588]: and ``live_migration_inbound_addr`` respectively. Apr 13 18:50:20 user devstack@n-api.service[61588]: ). Its value may be silently ignored in the future. Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 18:50:20 user devstack@n-api.service[61589]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 18:50:20 user devstack@n-api.service[61589]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 18:50:20 user devstack@n-api.service[61589]: and ``live_migration_inbound_addr`` respectively. Apr 13 18:50:20 user devstack@n-api.service[61589]: ). Its value may be silently ignored in the future. Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61587) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61588) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61587]: INFO dbcounter [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Registered counter for database nova_api Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61589) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG oslo_db.sqlalchemy.engines [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61587) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writer thread running {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 18:50:20 user devstack@n-api.service[61588]: INFO dbcounter [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Registered counter for database nova_api Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG oslo_db.sqlalchemy.engines [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61588) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writer thread running {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG nova.context [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d(cell1) {{(pid=61587) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 18:50:20 user devstack@n-api.service[61589]: INFO dbcounter [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Registered counter for database nova_api Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:50:20 user devstack@n-api.service[61587]: INFO dbcounter [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Registered counter for database nova_cell0 Apr 13 18:50:20 user devstack@n-api.service[61587]: INFO dbcounter [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Registered counter for database nova_cell1 Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG oslo_db.sqlalchemy.engines [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61587) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writer thread running {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG oslo_db.sqlalchemy.engines [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61587) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG oslo_db.sqlalchemy.engines [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61589) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writer thread running {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG nova.context [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d(cell1) {{(pid=61588) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:50:20 user devstack@n-api.service[61588]: INFO dbcounter [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Registered counter for database nova_cell0 Apr 13 18:50:20 user devstack@n-api.service[61588]: INFO dbcounter [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Registered counter for database nova_cell1 Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG oslo_db.sqlalchemy.engines [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61588) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writer thread running {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG oslo_db.sqlalchemy.engines [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61588) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG nova.context [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d(cell1) {{(pid=61589) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:50:20 user devstack@n-api.service[61589]: INFO dbcounter [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Registered counter for database nova_cell0 Apr 13 18:50:20 user devstack@n-api.service[61589]: INFO dbcounter [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Registered counter for database nova_cell1 Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG oslo_db.sqlalchemy.engines [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61589) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writer thread running {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG oslo_db.sqlalchemy.engines [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61589) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writer thread running {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 18:50:20 user devstack@n-api.service[61587]: INFO dbcounter [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Registered counter for database nova_cell0 Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG oslo_db.sqlalchemy.engines [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61587) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 18:50:20 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writer thread running {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writer thread running {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 18:50:20 user devstack@n-api.service[61588]: INFO dbcounter [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Registered counter for database nova_cell0 Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writer thread running {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 18:50:20 user devstack@n-api.service[61589]: INFO dbcounter [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Registered counter for database nova_cell0 Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG oslo_db.sqlalchemy.engines [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61589) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 18:50:20 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writer thread running {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG oslo_db.sqlalchemy.engines [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61588) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 18:50:20 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writer thread running {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 18:50:20 user devstack@n-api.service[61587]: WARNING keystonemiddleware.auth_token [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 18:50:20 user devstack@n-api.service[61587]: WARNING keystonemiddleware.auth_token [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 18:50:21 user devstack@n-api.service[61587]: WARNING keystonemiddleware.auth_token [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 18:50:21 user devstack@n-api.service[61587]: WARNING keystonemiddleware.auth_token [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 18:50:21 user devstack@n-api.service[61587]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560fa6df3990 pid: 61587 (default app) Apr 13 18:50:21 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:50:21 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001536 Apr 13 18:50:21 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 13 18:50:21 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:50:21 user devstack@n-api.service[61588]: WARNING keystonemiddleware.auth_token [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 18:50:21 user devstack@n-api.service[61589]: WARNING keystonemiddleware.auth_token [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 18:50:21 user devstack@n-api.service[61588]: WARNING keystonemiddleware.auth_token [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 18:50:21 user devstack@n-api.service[61589]: WARNING keystonemiddleware.auth_token [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 18:50:21 user devstack@n-api.service[61588]: WARNING keystonemiddleware.auth_token [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 18:50:21 user devstack@n-api.service[61588]: WARNING keystonemiddleware.auth_token [None req-35bd9249-88c8-4197-b4c0-ad5acf3b52ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 18:50:21 user devstack@n-api.service[61588]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560fa6df3990 pid: 61588 (default app) Apr 13 18:50:21 user devstack@n-api.service[61589]: WARNING keystonemiddleware.auth_token [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 18:50:21 user devstack@n-api.service[61589]: WARNING keystonemiddleware.auth_token [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 18:50:21 user devstack@n-api.service[61589]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560fa6df3990 pid: 61589 (default app) Apr 13 18:52:27 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:27 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-91e5b19f-2ce7-4bd0-9d09-1631983422dc None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003129 Apr 13 18:52:27 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 18:52:27 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:52:27 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=3 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:52:27 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=3 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:52:27 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=3 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:52:27 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=3 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:52:27 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0adf7a2a-3ba4-4c5f-87b7-d3daab7526dd admin admin] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:27 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-0adf7a2a-3ba4-4c5f-87b7-d3daab7526dd admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.378008 Apr 13 18:52:27 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 18:52:27 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:52:29 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:29 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002738 Apr 13 18:52:29 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 18:52:29 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:52:29 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:52:29 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:52:29 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:52:29 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:52:29 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-d1b05af6-571b-4763-8db9-7f985a96933b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:29 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-d1b05af6-571b-4763-8db9-7f985a96933b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.314645 Apr 13 18:52:29 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 18:52:29 2023] POST /compute/v2.1/flavors => generated 405 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:52:29 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-600906c6-ff6b-4bcd-892c-7f7ca78b52c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:29 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-600906c6-ff6b-4bcd-892c-7f7ca78b52c9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046849 Apr 13 18:52:29 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 18:52:29 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:52:31 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:31 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002960 Apr 13 18:52:31 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 18:52:31 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:52:32 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-2d0aad17-15cb-4f2d-b83c-9083abb42994 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "d1", "ram": 512, "rxtx_factor": 1.0}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:32 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-2d0aad17-15cb-4f2d-b83c-9083abb42994 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.089634 Apr 13 18:52:32 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 18:52:31 2023] POST /compute/v2.1/flavors => generated 402 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:52:32 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-369ba7f8-c64a-4d64-98d1-3420c926e33a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:32 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-369ba7f8-c64a-4d64-98d1-3420c926e33a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032033 Apr 13 18:52:32 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 18:52:32 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:52:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001415 Apr 13 18:52:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 18:52:34 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:52:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-8c5069a4-3408-4df7-8152-8d1d425fe6ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:34 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-8c5069a4-3408-4df7-8152-8d1d425fe6ef admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.083190 Apr 13 18:52:34 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 18:52:34 2023] POST /compute/v2.1/flavors => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:52:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-afed4c65-355b-4474-b342-6bf94675246f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-afed4c65-355b-4474-b342-6bf94675246f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029391 Apr 13 18:52:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 18:52:34 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:52:36 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:36 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001652 Apr 13 18:52:36 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 18:52:36 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:52:36 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-cd40b713-9ddd-42b8-b5b1-e45cc35783a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "disk": 10, "id": "d3", "name": "ds2G", "ram": 2048}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:36 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-cd40b713-9ddd-42b8-b5b1-e45cc35783a8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058240 Apr 13 18:52:36 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 18:52:36 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:52:36 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-6d95b378-e2a8-47d1-8289-27cfd2ea519c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:36 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-6d95b378-e2a8-47d1-8289-27cfd2ea519c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024615 Apr 13 18:52:36 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 18:52:36 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:52:38 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:38 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001515 Apr 13 18:52:38 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 18:52:38 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:52:38 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-960312ec-65f5-4e4c-ac8a-08d7400a20d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "id": "d4"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:38 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-960312ec-65f5-4e4c-ac8a-08d7400a20d4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065627 Apr 13 18:52:38 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 18:52:38 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:52:38 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:38 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023564 Apr 13 18:52:38 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 18:52:38 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:52:40 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:40 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-646dd523-0b95-400f-857a-30ce85cd5cc0 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001446 Apr 13 18:52:40 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 18:52:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:52:40 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-844eb0c1-5026-4a87-9473-97a0fdec31ef admin admin] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-844eb0c1-5026-4a87-9473-97a0fdec31ef admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.071091 Apr 13 18:52:40 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 18:52:40 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:52:42 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001581 Apr 13 18:52:42 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 18:52:42 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:52:42 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:52:42 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:52:42 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:52:42 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:52:42 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9ca522b0-1f59-439e-a5e0-e00fa79cd881 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:42 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-9ca522b0-1f59-439e-a5e0-e00fa79cd881 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.344988 Apr 13 18:52:42 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 18:52:42 2023] POST /compute/v2.1/flavors => generated 400 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:52:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-72dac8c4-339f-43e1-8c7b-2645321389a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-72dac8c4-339f-43e1-8c7b-2645321389a9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040289 Apr 13 18:52:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 18:52:42 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:52:44 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001950 Apr 13 18:52:44 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 18:52:44 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:52:44 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-346f894d-2c64-4159-839f-840ba3d82664 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "id": "2", "ram": 2048, "disk": 20, "swap": 0}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:45 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-346f894d-2c64-4159-839f-840ba3d82664 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.221432 Apr 13 18:52:45 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 18:52:44 2023] POST /compute/v2.1/flavors => generated 403 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:52:45 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-f88385ab-20c2-4e02-a6a3-705ad86118fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:45 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-f88385ab-20c2-4e02-a6a3-705ad86118fc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025754 Apr 13 18:52:45 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 18:52:45 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:52:47 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001982 Apr 13 18:52:47 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 18:52:47 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:52:47 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d75f36e1-a612-4e23-908c-2351f6fd9a3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d75f36e1-a612-4e23-908c-2351f6fd9a3e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.060771 Apr 13 18:52:47 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 18:52:47 2023] POST /compute/v2.1/flavors => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:52:47 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-b2a8bdb1-96a8-4d93-9317-c31ccff9fcc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:47 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-b2a8bdb1-96a8-4d93-9317-c31ccff9fcc0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023797 Apr 13 18:52:47 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 18:52:47 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:52:49 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:49 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001324 Apr 13 18:52:49 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 18:52:49 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:52:49 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-00054871-41ee-4b15-9152-700488c4706e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-00054871-41ee-4b15-9152-700488c4706e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.082669 Apr 13 18:52:49 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 18:52:49 2023] POST /compute/v2.1/flavors => generated 403 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:52:49 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a5355f74-8a30-44fe-a88a-f81b0d438cb5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:49 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a5355f74-8a30-44fe-a88a-f81b0d438cb5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026529 Apr 13 18:52:49 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 18:52:49 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:52:51 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:52:51 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001503 Apr 13 18:52:51 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 18:52:51 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:52:51 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ada0c33d-1cf4-4ca5-8a13-8bbcfbee6716 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:51 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ada0c33d-1cf4-4ca5-8a13-8bbcfbee6716 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.082993 Apr 13 18:52:51 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 18:52:51 2023] POST /compute/v2.1/flavors => generated 406 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:52:51 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a2125ffc-9e69-4936-98cd-7563cda690ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:52:51 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a2125ffc-9e69-4936-98cd-7563cda690ab admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024765 Apr 13 18:52:51 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 18:52:51 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:53:21 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:53:21 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-b8924256-798b-4a51-9f89-668b4b8c3d6f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001365 Apr 13 18:53:21 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 18:53:21 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:53:21 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:53:21 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fe99e111-e9a2-458e-9710-54929d137b1a admin admin] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:53:21 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fe99e111-e9a2-458e-9710-54929d137b1a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:53:21 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fe99e111-e9a2-458e-9710-54929d137b1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:53:21 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fe99e111-e9a2-458e-9710-54929d137b1a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:53:21 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fe99e111-e9a2-458e-9710-54929d137b1a admin admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:53:21 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fe99e111-e9a2-458e-9710-54929d137b1a admin admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:53:21 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fe99e111-e9a2-458e-9710-54929d137b1a admin admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:53:21 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-fe99e111-e9a2-458e-9710-54929d137b1a admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.090824 Apr 13 18:53:21 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 13 18:53:21 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:53:53 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a2125ffc-9e69-4936-98cd-7563cda690ab admin admin] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:53:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a2125ffc-9e69-4936-98cd-7563cda690ab admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001460 Apr 13 18:53:53 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 18:53:53 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:53:53 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:53:53 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-3f5f8688-b9a1-426a-9a51-56d5f168f064 admin admin] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:53:53 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-3f5f8688-b9a1-426a-9a51-56d5f168f064 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.088651 Apr 13 18:53:53 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 13 18:53:53 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:53:57 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fe99e111-e9a2-458e-9710-54929d137b1a admin admin] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:53:57 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-fe99e111-e9a2-458e-9710-54929d137b1a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003221 Apr 13 18:53:57 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 18:53:57 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:53:57 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:53:57 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-515147a9-4114-4b17-b8de-03fa017a4e82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "42", "name": "m1.nano", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 128, "vcpus": 1, "disk": 1}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:53:57 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-515147a9-4114-4b17-b8de-03fa017a4e82 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.062055 Apr 13 18:53:57 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 18:53:57 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:53:57 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ea41836d-6138-4244-bfbc-9fdf9708667c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:53:57 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-ea41836d-6138-4244-bfbc-9fdf9708667c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024614 Apr 13 18:53:57 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 18:53:57 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:54:02 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fe99e111-e9a2-458e-9710-54929d137b1a admin admin] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:54:02 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-fe99e111-e9a2-458e-9710-54929d137b1a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001483 Apr 13 18:54:02 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 18:54:02 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:54:02 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-f6f2cc1d-a102-44b8-84c6-92100d2267c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "84", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 192, "disk": 1}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:54:02 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-f6f2cc1d-a102-44b8-84c6-92100d2267c9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069363 Apr 13 18:54:02 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 18:54:02 2023] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:54:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4b6e38f9-7168-41f8-a62b-eb10ff27c7c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:54:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-4b6e38f9-7168-41f8-a62b-eb10ff27c7c9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026736 Apr 13 18:54:02 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 18:54:02 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:56:15 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:56:15 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:56:15 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:56:15 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ff599e21-f5d0-4ea9-98b1-70352fa2c24d tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Action: 'create', calling method: .version_select at 0x7efe38f9aa70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2002941655"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ff599e21-f5d0-4ea9-98b1-70352fa2c24d tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.511222 Apr 13 18:56:16 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 13 18:56:15 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 1513 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 18:56:16 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:56:16 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a3b131d7-626d-44ec-8792-171b96ad3368 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38f97370>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:17 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a3b131d7-626d-44ec-8792-171b96ad3368 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710" status: 200 len: 345 microversion: 2.1 time: 0.653918 Apr 13 18:56:17 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:56:16 2023] GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 => generated 345 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:18 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:56:18 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-2782f0ec-964c-4d2d-a9f4-c74ae96cf9f8 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe390a7a30>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:18 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-2782f0ec-964c-4d2d-a9f4-c74ae96cf9f8 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710" status: 200 len: 346 microversion: 2.1 time: 0.333732 Apr 13 18:56:18 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:56:18 2023] GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 => generated 346 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:18 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8b085281-814c-42d7-ab5c-e04ea564fb10 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Action: 'create', calling method: .version_select at 0x7efe38e281f0>, body: {"snapshot": {"volume_id": "c75554f5-61ef-4103-b286-ff23347d4710", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-258210677"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-8b085281-814c-42d7-ab5c-e04ea564fb10 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.244417 Apr 13 18:56:19 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 16/49] 10.0.0.210 () {64 vars in 1239 bytes} [Thu Apr 13 18:56:18 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-49dcde74-dde6-412c-9987-bcc5b3c51959 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e1b910>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-49dcde74-dde6-412c-9987-bcc5b3c51959 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da" status: 200 len: 286 microversion: 2.1 time: 0.076840 Apr 13 18:56:19 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 18:56:19 2023] GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:19 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e7bae824-4303-458d-98a3-28e9ea1d8275 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e13370>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:19 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e7bae824-4303-458d-98a3-28e9ea1d8275 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.052989 Apr 13 18:56:19 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 18:56:19 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:19 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-47294263-044d-4ad3-acf8-33713d20ecf1 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e29480>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-47294263-044d-4ad3-acf8-33713d20ecf1 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da" status: 200 len: 286 microversion: 2.1 time: 0.032638 Apr 13 18:56:19 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 18:56:19 2023] GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-b2a5f680-1549-4d49-8555-4a5a766ca8f0 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e3c0d0>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:20 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-b2a5f680-1549-4d49-8555-4a5a766ca8f0 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da" status: 200 len: 286 microversion: 2.1 time: 0.043067 Apr 13 18:56:20 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 18:56:20 2023] GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:21 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c2a89a65-3dbc-462e-a6a2-ed2e0012f8bc tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e20790>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:21 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-c2a89a65-3dbc-462e-a6a2-ed2e0012f8bc tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da" status: 200 len: 287 microversion: 2.1 time: 0.056573 Apr 13 18:56:21 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 18:56:21 2023] GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:21 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d22bcd7a-c40c-4f49-a644-e7b1b7f596e7 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e29750>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:21 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d22bcd7a-c40c-4f49-a644-e7b1b7f596e7 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da" status: 202 len: 0 microversion: 2.1 time: 0.064646 Apr 13 18:56:21 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 13 18:56:21 2023] DELETE /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:56:21 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ed6863c2-4070-45a3-920c-fab4fcd51a68 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e1bb50>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:21 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-ed6863c2-4070-45a3-920c-fab4fcd51a68 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da" status: 200 len: 286 microversion: 2.1 time: 0.037764 Apr 13 18:56:21 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 18:56:21 2023] GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:22 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-07a82810-4adb-4f05-928f-49ff8336165e tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e13be0>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-07a82810-4adb-4f05-928f-49ff8336165e tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da" status: 200 len: 286 microversion: 2.1 time: 0.032648 Apr 13 18:56:22 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 18:56:22 2023] GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:23 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d411b61a-96e2-4949-b7b4-0fd0b79789c7 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e28f70>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-d411b61a-96e2-4949-b7b4-0fd0b79789c7 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] HTTP exception thrown: Snapshot e2de70a7-84fc-48e8-bd44-5c6a591320da could not be found. Apr 13 18:56:23 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d411b61a-96e2-4949-b7b4-0fd0b79789c7 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Request method failure captured: Apr 13 18:56:23 user devstack@n-api.service[61589]: request: GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da HTTP/1.1 Apr 13 18:56:23 user devstack@n-api.service[61589]: Accept: application/json Apr 13 18:56:23 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 18:56:23 user devstack@n-api.service[61589]: Connection: close Apr 13 18:56:23 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 18:56:23 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 18:56:23 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 18:56:23 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 18:56:23 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBPmwKxYGI09Q_-YEgk4SMithQsrQGIcAaRaHxPbythMh78iKDj9UNOWuSf8kGv1TlFZAqkrRr3UjlSkI_N1g3R1nsJMZgXfFiiF7U8XaS_ci2xJ987Ajwm8Qypc5kRw4ZPeCDfet3Z1MQYttRvgW5ZOm5bHqrKA4HtpCq5Y8ZL2Wg Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Project-Id: 71a46f93717a40d5a6535076d50f4449 Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-732987884 Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71a46f93717a40d5a6535076d50f4449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71a46f93717a40d5a6535076d50f4449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71a46f93717a40d5a6535076d50f4449"}]}] Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-732987884 Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Tenant-Id: 71a46f93717a40d5a6535076d50f4449 Apr 13 18:56:23 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-732987884 Apr 13 18:56:23 user devstack@n-api.service[61589]: X-User: tempest-VolumesSnapshotsTestJSON-732987884-project-member Apr 13 18:56:23 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 18:56:23 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 18:56:23 user devstack@n-api.service[61589]: X-User-Id: 44f974f8b146462e9fff4ed5754f5688 Apr 13 18:56:23 user devstack@n-api.service[61589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-732987884-project-member Apr 13 18:56:23 user devstack@n-api.service[61589]: method: Apr 13 18:56:23 user devstack@n-api.service[61589]: exception: Snapshot e2de70a7-84fc-48e8-bd44-5c6a591320da could not be found. Apr 13 18:56:23 user devstack@n-api.service[61589]: action_args: {'id': 'e2de70a7-84fc-48e8-bd44-5c6a591320da'} Apr 13 18:56:23 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e2de70a7-84fc-48e8-bd44-5c6a591320da could not be found. (HTTP 404) (Request-ID: req-5d474a0c-7dc7-4ffa-aa43-1be1aade9a46) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e2de70a7-84fc-48e8-bd44-5c6a591320da could not be found. Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e2de70a7-84fc-48e8-bd44-5c6a591320da could not be found. Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e2de70a7-84fc-48e8-bd44-5c6a591320da could not be found. Apr 13 18:56:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:23 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d411b61a-96e2-4949-b7b4-0fd0b79789c7 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Returning 404 to user: Snapshot e2de70a7-84fc-48e8-bd44-5c6a591320da could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:56:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d411b61a-96e2-4949-b7b4-0fd0b79789c7 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da" status: 404 len: 111 microversion: 2.1 time: 0.037723 Apr 13 18:56:23 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 18:56:23 2023] GET /compute/v2.1/os-snapshots/e2de70a7-84fc-48e8-bd44-5c6a591320da => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:56:23 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-f8be9f3e-035c-4846-aa64-07551d94b816 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e3c3a0>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:23 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-f8be9f3e-035c-4846-aa64-07551d94b816 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710" status: 202 len: 0 microversion: 2.1 time: 0.073946 Apr 13 18:56:23 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 18:56:23 2023] DELETE /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:56:23 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-8a8cde51-d90d-4cf2-838b-78db1247ded3 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e13400>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:23 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-8a8cde51-d90d-4cf2-838b-78db1247ded3 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710" status: 200 len: 345 microversion: 2.1 time: 0.048686 Apr 13 18:56:23 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:56:23 2023] GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:24 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-97a1ebc3-f9c6-47e5-b59b-d098718eef85 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e280d0>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-97a1ebc3-f9c6-47e5-b59b-d098718eef85 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710" status: 200 len: 345 microversion: 2.1 time: 0.064850 Apr 13 18:56:24 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:56:24 2023] GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-d2e33ebb-7f58-47d3-b4ee-4430f022d80a tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e3c820>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-d2e33ebb-7f58-47d3-b4ee-4430f022d80a tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710" status: 200 len: 345 microversion: 2.1 time: 0.074039 Apr 13 18:56:25 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:56:25 2023] GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:26 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-72d551cb-8be1-49b3-8c04-ed37d087d47b tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e20940>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:27 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-72d551cb-8be1-49b3-8c04-ed37d087d47b tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710" status: 200 len: 345 microversion: 2.1 time: 0.103950 Apr 13 18:56:27 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 21/63] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:56:26 2023] GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 => generated 345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:27 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-cfc3704d-e911-42b5-a599-b9f60c2ba531 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Action: 'create', calling method: .version_select at 0x7efe38e29fc0>, body: {"keypair": {"name": "tempest-keypair-1245494573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE5B1S6SqZNLSYUvXCtLzlE03oQZAx0ezu9QmfHUm/VQFyAV9bhAsOFjrmYjBIjMOSTPvvajdVY1JHSqXEdUecpJFgE/NvFW0y7bhYdRssG3xIWyUJMMg1figOyi2kGeg=="}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:27 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-cfc3704d-e911-42b5-a599-b9f60c2ba531 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting quotas for project 63b52d6508154a918a13b31712b32796. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:56:27 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-cfc3704d-e911-42b5-a599-b9f60c2ba531 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting quotas for user ba70f34af8664dc89fd9851d00d5b96d and project 63b52d6508154a918a13b31712b32796. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:56:27 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-cfc3704d-e911-42b5-a599-b9f60c2ba531 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.228651 Apr 13 18:56:27 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 21/64] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 18:56:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-34845140-64d4-4545-ad9f-030fec5504e2 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e1bf40>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-34845140-64d4-4545-ad9f-030fec5504e2 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] HTTP exception thrown: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-34845140-64d4-4545-ad9f-030fec5504e2 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Request method failure captured: Apr 13 18:56:28 user devstack@n-api.service[61587]: request: GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 HTTP/1.1 Apr 13 18:56:28 user devstack@n-api.service[61587]: Accept: application/json Apr 13 18:56:28 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 18:56:28 user devstack@n-api.service[61587]: Connection: close Apr 13 18:56:28 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 18:56:28 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 18:56:28 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 18:56:28 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 18:56:28 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBPmwKxYGI09Q_-YEgk4SMithQsrQGIcAaRaHxPbythMh78iKDj9UNOWuSf8kGv1TlFZAqkrRr3UjlSkI_N1g3R1nsJMZgXfFiiF7U8XaS_ci2xJ987Ajwm8Qypc5kRw4ZPeCDfet3Z1MQYttRvgW5ZOm5bHqrKA4HtpCq5Y8ZL2Wg Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Project-Id: 71a46f93717a40d5a6535076d50f4449 Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-732987884 Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71a46f93717a40d5a6535076d50f4449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71a46f93717a40d5a6535076d50f4449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71a46f93717a40d5a6535076d50f4449"}]}] Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Tenant: tempest-VolumesSnapshotsTestJSON-732987884 Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Tenant-Id: 71a46f93717a40d5a6535076d50f4449 Apr 13 18:56:28 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-732987884 Apr 13 18:56:28 user devstack@n-api.service[61587]: X-User: tempest-VolumesSnapshotsTestJSON-732987884-project-member Apr 13 18:56:28 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 18:56:28 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 18:56:28 user devstack@n-api.service[61587]: X-User-Id: 44f974f8b146462e9fff4ed5754f5688 Apr 13 18:56:28 user devstack@n-api.service[61587]: X-User-Name: tempest-VolumesSnapshotsTestJSON-732987884-project-member Apr 13 18:56:28 user devstack@n-api.service[61587]: method: Apr 13 18:56:28 user devstack@n-api.service[61587]: exception: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61587]: action_args: {'id': 'c75554f5-61ef-4103-b286-ff23347d4710'} Apr 13 18:56:28 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. (HTTP 404) (Request-ID: req-87e0b056-3e56-4f1b-8bd4-98d84b4bb765) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-34845140-64d4-4545-ad9f-030fec5504e2 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Returning 404 to user: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:56:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-34845140-64d4-4545-ad9f-030fec5504e2 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710" status: 404 len: 109 microversion: 2.1 time: 0.049768 Apr 13 18:56:28 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 23/65] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:56:28 2023] GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:56:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c6a4d2cb-d29d-4d18-a232-c679118c2c90 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38e13370>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-c6a4d2cb-d29d-4d18-a232-c679118c2c90 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] HTTP exception thrown: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c6a4d2cb-d29d-4d18-a232-c679118c2c90 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Request method failure captured: Apr 13 18:56:28 user devstack@n-api.service[61588]: request: DELETE /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 HTTP/1.1 Apr 13 18:56:28 user devstack@n-api.service[61588]: Accept: application/json Apr 13 18:56:28 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 18:56:28 user devstack@n-api.service[61588]: Connection: close Apr 13 18:56:28 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 18:56:28 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 18:56:28 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 18:56:28 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 18:56:28 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBPmwKxYGI09Q_-YEgk4SMithQsrQGIcAaRaHxPbythMh78iKDj9UNOWuSf8kGv1TlFZAqkrRr3UjlSkI_N1g3R1nsJMZgXfFiiF7U8XaS_ci2xJ987Ajwm8Qypc5kRw4ZPeCDfet3Z1MQYttRvgW5ZOm5bHqrKA4HtpCq5Y8ZL2Wg Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Project-Id: 71a46f93717a40d5a6535076d50f4449 Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-732987884 Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71a46f93717a40d5a6535076d50f4449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71a46f93717a40d5a6535076d50f4449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71a46f93717a40d5a6535076d50f4449"}]}] Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Tenant: tempest-VolumesSnapshotsTestJSON-732987884 Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Tenant-Id: 71a46f93717a40d5a6535076d50f4449 Apr 13 18:56:28 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-732987884 Apr 13 18:56:28 user devstack@n-api.service[61588]: X-User: tempest-VolumesSnapshotsTestJSON-732987884-project-member Apr 13 18:56:28 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 18:56:28 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 18:56:28 user devstack@n-api.service[61588]: X-User-Id: 44f974f8b146462e9fff4ed5754f5688 Apr 13 18:56:28 user devstack@n-api.service[61588]: X-User-Name: tempest-VolumesSnapshotsTestJSON-732987884-project-member Apr 13 18:56:28 user devstack@n-api.service[61588]: method: Apr 13 18:56:28 user devstack@n-api.service[61588]: exception: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61588]: action_args: {'id': 'c75554f5-61ef-4103-b286-ff23347d4710'} Apr 13 18:56:28 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. (HTTP 404) (Request-ID: req-db20176d-b9a9-46c7-ab2e-f4dc427a993c) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c6a4d2cb-d29d-4d18-a232-c679118c2c90 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Returning 404 to user: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:56:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-c6a4d2cb-d29d-4d18-a232-c679118c2c90 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710" status: 404 len: 109 microversion: 2.1 time: 0.054357 Apr 13 18:56:28 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 18:56:28 2023] DELETE /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:56:28 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-92178009-c4aa-4f84-83ba-52fe8201fdf7 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Calling method '.version_select at 0x7efe38ee2dd0>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:28 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-92178009-c4aa-4f84-83ba-52fe8201fdf7 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] HTTP exception thrown: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-92178009-c4aa-4f84-83ba-52fe8201fdf7 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Request method failure captured: Apr 13 18:56:28 user devstack@n-api.service[61589]: request: GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 HTTP/1.1 Apr 13 18:56:28 user devstack@n-api.service[61589]: Accept: application/json Apr 13 18:56:28 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 18:56:28 user devstack@n-api.service[61589]: Connection: close Apr 13 18:56:28 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 18:56:28 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 18:56:28 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 18:56:28 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 18:56:28 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBPmwKxYGI09Q_-YEgk4SMithQsrQGIcAaRaHxPbythMh78iKDj9UNOWuSf8kGv1TlFZAqkrRr3UjlSkI_N1g3R1nsJMZgXfFiiF7U8XaS_ci2xJ987Ajwm8Qypc5kRw4ZPeCDfet3Z1MQYttRvgW5ZOm5bHqrKA4HtpCq5Y8ZL2Wg Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Project-Id: 71a46f93717a40d5a6535076d50f4449 Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-732987884 Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71a46f93717a40d5a6535076d50f4449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71a46f93717a40d5a6535076d50f4449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71a46f93717a40d5a6535076d50f4449"}]}] Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-732987884 Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Tenant-Id: 71a46f93717a40d5a6535076d50f4449 Apr 13 18:56:28 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-732987884 Apr 13 18:56:28 user devstack@n-api.service[61589]: X-User: tempest-VolumesSnapshotsTestJSON-732987884-project-member Apr 13 18:56:28 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 18:56:28 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 18:56:28 user devstack@n-api.service[61589]: X-User-Id: 44f974f8b146462e9fff4ed5754f5688 Apr 13 18:56:28 user devstack@n-api.service[61589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-732987884-project-member Apr 13 18:56:28 user devstack@n-api.service[61589]: method: Apr 13 18:56:28 user devstack@n-api.service[61589]: exception: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61589]: action_args: {'id': 'c75554f5-61ef-4103-b286-ff23347d4710'} Apr 13 18:56:28 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. (HTTP 404) (Request-ID: req-adddfe1a-a9ed-4973-b428-be22ed3a467a) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. Apr 13 18:56:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:56:28 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-92178009-c4aa-4f84-83ba-52fe8201fdf7 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] Returning 404 to user: Volume c75554f5-61ef-4103-b286-ff23347d4710 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:56:28 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-92178009-c4aa-4f84-83ba-52fe8201fdf7 tempest-VolumesSnapshotsTestJSON-732987884 tempest-VolumesSnapshotsTestJSON-732987884-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710" status: 404 len: 109 microversion: 2.1 time: 0.051081 Apr 13 18:56:28 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 22/67] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:56:28 2023] GET /compute/v2.1/os-volumes/c75554f5-61ef-4103-b286-ff23347d4710 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:56:30 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-223135583", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "4f040dc3-577a-48e7-b46d-413f3b11a1fe"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:30 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] validate_networks() for [('4f040dc3-577a-48e7-b46d-413f3b11a1fe', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Getting quotas for project b577e81535534db29f5c81837949e958. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Getting quotas for user c1424be1648d4e8081f6a679b1407d3a and project b577e81535534db29f5c81837949e958. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:56:33 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:56:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.081007 Apr 13 18:56:33 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 24/68] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:56:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 3082 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:56:33 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-98506ed1-f4ec-4e07-b393-09da9ffe676c tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:33 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-98506ed1-f4ec-4e07-b393-09da9ffe676c tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:56:33 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-98506ed1-f4ec-4e07-b393-09da9ffe676c tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1424be1648d4e8081f6a679b1407d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b577e81535534db29f5c81837949e958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:56:33 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-98506ed1-f4ec-4e07-b393-09da9ffe676c tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a" status: 200 len: 1208 microversion: 2.1 time: 0.235803 Apr 13 18:56:33 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 23/69] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:56:33 2023] GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a => generated 1208 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:56:33 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-401678638", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2def9fdd-c85f-497e-b62d-2b5585207128"}], "security_groups": [{"name": "tempest-securitygroup--1786926797"}], "key_name": "tempest-keypair-1245494573", "user_data": "}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:34 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] validate_networks() for [('2def9fdd-c85f-497e-b62d-2b5585207128', None, None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:56:35 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c081ce96-f698-40ad-bef2-87961f404e73 tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] Calling method '.version_select at 0x7efe38d52cb0>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:35 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-c081ce96-f698-40ad-bef2-87961f404e73 tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3e7a2191-deed-4242-971b-5f2dd70a6e4d" status: 200 len: 351 microversion: 2.1 time: 0.066688 Apr 13 18:56:35 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 25/70] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:56:35 2023] GET /compute/v2.1/os-volumes/3e7a2191-deed-4242-971b-5f2dd70a6e4d => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting quotas for project 63b52d6508154a918a13b31712b32796. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting quotas for user ba70f34af8664dc89fd9851d00d5b96d and project 63b52d6508154a918a13b31712b32796. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:56:35 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:56:35 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.099749 Apr 13 18:56:35 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 23/71] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:56:33 2023] POST /compute/v2.1/servers => generated 400 bytes in 2103 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:56:35 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-fc93ad73-55d9-44a5-b588-1dca6b9551dc tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:35 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-fc93ad73-55d9-44a5-b588-1dca6b9551dc tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:56:36 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-fc93ad73-55d9-44a5-b588-1dca6b9551dc tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:56:36 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-fc93ad73-55d9-44a5-b588-1dca6b9551dc tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 200 len: 1231 microversion: 2.1 time: 0.118924 Apr 13 18:56:36 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 24/72] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:56:35 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 1231 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:56:36 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-427290e5-8031-4aa2-8b6b-08d594596fd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Action: 'create', calling method: .version_select at 0x7efe38d53130>, body: {"keypair": {"name": "tempest-keypair-1219895845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMydqo7bmRL3ACZzwkGDc5E4wLELR7X8fXhb12zGOXMBXei6xirNWcHiWE3B5l9MrFe74EHnr4RXCIBAisEn3x6JzBkNkUkW7rpPbUx5zSUBeEYIWhZNJiv3ehZ9wfugA=="}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:36 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-427290e5-8031-4aa2-8b6b-08d594596fd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting quotas for project faabdcc8e61c452ab3b934b1c9501e68. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:56:37 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-427290e5-8031-4aa2-8b6b-08d594596fd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting quotas for user ee6c76c605d54b4f84e0596b27087f0b and project faabdcc8e61c452ab3b934b1c9501e68. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:56:37 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-427290e5-8031-4aa2-8b6b-08d594596fd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.418037 Apr 13 18:56:37 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 26/73] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 18:56:36 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 420 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 18:56:37 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-6a59b9c5-1d16-4f65-bc55-75e9f6f810fb tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Action: 'create', calling method: .version_select at 0x7efe38d19d80>, body: {"keypair": {"name": "tempest-keypair-479347877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw=="}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:37 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-6a59b9c5-1d16-4f65-bc55-75e9f6f810fb tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for project c162f91cba4b4ecf9de48fbf839da261. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:56:37 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-6a59b9c5-1d16-4f65-bc55-75e9f6f810fb tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for user df209814208d415e9d414d39205aaad6 and project c162f91cba4b4ecf9de48fbf839da261. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:56:37 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-6a59b9c5-1d16-4f65-bc55-75e9f6f810fb tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.209610 Apr 13 18:56:37 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 24/74] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 18:56:37 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:37 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4c7ea1c3-8bf3-4dd7-a990-7071e0b8345b tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] Calling method '.version_select at 0x7efe38e23ac0>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-4c7ea1c3-8bf3-4dd7-a990-7071e0b8345b tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/629971e1-3cbc-4a26-9998-592fbedbd57d" status: 200 len: 350 microversion: 2.1 time: 0.089940 Apr 13 18:56:37 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 25/75] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:56:37 2023] GET /compute/v2.1/os-volumes/629971e1-3cbc-4a26-9998-592fbedbd57d => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:39 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-dad0f39b-7d20-465b-8516-ba81a388c7f5 tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] Calling method '.version_select at 0x7efe38d52950>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:39 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-dad0f39b-7d20-465b-8516-ba81a388c7f5 tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/91a3174c-a033-4074-8c2c-4122ff01ac08" status: 200 len: 351 microversion: 2.1 time: 0.066653 Apr 13 18:56:39 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 27/76] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:56:39 2023] GET /compute/v2.1/os-volumes/91a3174c-a033-4074-8c2c-4122ff01ac08 => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:39 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fbf8ae8e-a72a-49bc-b797-09a19ccb1224 tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] Calling method '.version_select at 0x7efe38d1b2e0>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:39 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-fbf8ae8e-a72a-49bc-b797-09a19ccb1224 tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090331 Apr 13 18:56:39 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 25/77] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 18:56:39 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:56:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-5c98766d-240e-4a19-8b18-ebf2f91e1dd0 tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] Calling method '.version_select at 0x7efe38e23e20>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-5c98766d-240e-4a19-8b18-ebf2f91e1dd0 tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091006 Apr 13 18:56:39 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 26/78] 10.0.0.210 () {62 vars in 1226 bytes} [Thu Apr 13 18:56:39 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:39 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-87de496d-08cc-4769-9d06-787687f28fce tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] Calling method '.version_select at 0x7efe38d788b0>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:39 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-87de496d-08cc-4769-9d06-787687f28fce tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.106516 Apr 13 18:56:39 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 28/79] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 18:56:39 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:56:39 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-326b2dc5-ca09-4e44-b0f4-55f0fc45276b tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] Calling method '.version_select at 0x7efe38d1bd90>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:40 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-326b2dc5-ca09-4e44-b0f4-55f0fc45276b tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.128217 Apr 13 18:56:40 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 26/80] 10.0.0.210 () {62 vars in 1244 bytes} [Thu Apr 13 18:56:39 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:40 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4b60ba00-237e-477f-b007-0219bbb9989a tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] Calling method '.version_select at 0x7efe38e23010>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-4b60ba00-237e-477f-b007-0219bbb9989a tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.161007 Apr 13 18:56:40 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 27/81] 10.0.0.210 () {62 vars in 1247 bytes} [Thu Apr 13 18:56:40 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:40 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3c7d5ba0-fdb9-4bf4-8f40-c93ef83685db tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] Calling method '.version_select at 0x7efe38d79bd0>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-3c7d5ba0-fdb9-4bf4-8f40-c93ef83685db tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.102123 Apr 13 18:56:40 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 29/82] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 18:56:40 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:56:40 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-7e574bd0-7240-4e72-b259-fb613256cff9 tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] Calling method '.version_select at 0x7efe38ed5000>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:40 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1933750656", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f"}]}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-7e574bd0-7240-4e72-b259-fb613256cff9 tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087267 Apr 13 18:56:40 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 28/83] 10.0.0.210 () {62 vars in 1265 bytes} [Thu Apr 13 18:56:40 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:40 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] validate_networks() for [('ae895ef0-18d7-4f77-bcc6-bcb3dd22026f', None, None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:56:40 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-7a634307-bafb-4c15-877f-614754d0eca5 tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] Calling method '.version_select at 0x7efe38d79a20>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-7a634307-bafb-4c15-877f-614754d0eca5 tempest-VolumesTestJSON-448260657 tempest-VolumesTestJSON-448260657-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088804 Apr 13 18:56:40 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 30/84] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 18:56:40 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Getting quotas for project a1308cc4c5734de9a9fd83688c8da796. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Getting quotas for user 3e7f76b4b7fb4651b3bce0e72f8a4de6 and project a1308cc4c5734de9a9fd83688c8da796. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:56:42 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:56:42 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.870044 Apr 13 18:56:42 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 27/85] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:56:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:56:42 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-cc88c07b-7349-4a80-96e1-47101b8b9f5f tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:42 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-cc88c07b-7349-4a80-96e1-47101b8b9f5f tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:56:42 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-cc88c07b-7349-4a80-96e1-47101b8b9f5f tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7f76b4b7fb4651b3bce0e72f8a4de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1308cc4c5734de9a9fd83688c8da796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:56:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-cc88c07b-7349-4a80-96e1-47101b8b9f5f tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a" status: 200 len: 1211 microversion: 2.1 time: 0.164688 Apr 13 18:56:42 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 29/86] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:56:42 2023] GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a => generated 1211 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:56:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-167054456", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab"}], "security_groups": [{"name": "tempest-securitygroup--2079668515"}], "key_name": "tempest-keypair-1219895845", "user_data": "}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:43 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] validate_networks() for [('9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:56:43 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:56:43 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d32500-da20-4a99-af04-5f422ac6ba0a", "tag": "1572a520-f7d8-4a48-995e-9a83a99a41c8"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:43 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] Creating event network-changed:1572a520-f7d8-4a48-995e-9a83a99a41c8 for instance b7d32500-da20-4a99-af04-5f422ac6ba0a on user Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61589) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61589) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66449afa-eb25-41eb-9dc1-1dec18d399f1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66449afa-eb25-41eb-9dc1-1dec18d399f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66449afa-eb25-41eb-9dc1-1dec18d399f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66449afa-eb25-41eb-9dc1-1dec18d399f1 None None] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66449afa-eb25-41eb-9dc1-1dec18d399f1 None None] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66449afa-eb25-41eb-9dc1-1dec18d399f1 None None] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:43 user devstack@n-api.service[61589]: INFO nova.compute.rpcapi [None req-66449afa-eb25-41eb-9dc1-1dec18d399f1 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 18:56:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66449afa-eb25-41eb-9dc1-1dec18d399f1 None None] Releasing lock "compute-rpcapi-router" {{(pid=61589) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 18:56:43 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-66449afa-eb25-41eb-9dc1-1dec18d399f1 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151511 Apr 13 18:56:43 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 28/87] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:56:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] Creating event network-changed:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61588) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] Acquired lock "compute-rpcapi-router" {{(pid=61588) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36c12a8f-7383-47a7-b6f8-40029c08fc00 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36c12a8f-7383-47a7-b6f8-40029c08fc00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36c12a8f-7383-47a7-b6f8-40029c08fc00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36c12a8f-7383-47a7-b6f8-40029c08fc00 None None] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36c12a8f-7383-47a7-b6f8-40029c08fc00 None None] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36c12a8f-7383-47a7-b6f8-40029c08fc00 None None] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:43 user devstack@n-api.service[61588]: INFO nova.compute.rpcapi [None req-36c12a8f-7383-47a7-b6f8-40029c08fc00 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 18:56:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36c12a8f-7383-47a7-b6f8-40029c08fc00 None None] Releasing lock "compute-rpcapi-router" {{(pid=61588) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 18:56:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-36c12a8f-7383-47a7-b6f8-40029c08fc00 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149521 Apr 13 18:56:43 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 30/88] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:56:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting quotas for project faabdcc8e61c452ab3b934b1c9501e68. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting quotas for user ee6c76c605d54b4f84e0596b27087f0b and project faabdcc8e61c452ab3b934b1c9501e68. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:56:46 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:56:46 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 3.787745 Apr 13 18:56:46 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 31/89] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 18:56:42 2023] POST /compute/v2.1/servers => generated 400 bytes in 3789 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 18:56:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7f03c815-3da5-43a8-b5ac-bbffe96a2fbb tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:46 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-7f03c815-3da5-43a8-b5ac-bbffe96a2fbb tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:56:46 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-7f03c815-3da5-43a8-b5ac-bbffe96a2fbb tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:56:46 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-7f03c815-3da5-43a8-b5ac-bbffe96a2fbb tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:56:46 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-7f03c815-3da5-43a8-b5ac-bbffe96a2fbb tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:56:46 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7f03c815-3da5-43a8-b5ac-bbffe96a2fbb tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f" status: 200 len: 1275 microversion: 2.20 time: 0.335536 Apr 13 18:56:46 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 29/90] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:56:46 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f => generated 1275 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:56:47 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-657008190", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f"}], "security_groups": [{"name": "tempest-securitygroup--1715513541"}], "key_name": "tempest-keypair-479347877", "user_data": "}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:47 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f17525a6-e377-4b33-85cd-88a7aaf4569a", "tag": "209c6974-cf54-4917-a9dc-2608f9eb10d9"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] Creating event network-changed:209c6974-cf54-4917-a9dc-2608f9eb10d9 for instance f17525a6-e377-4b33-85cd-88a7aaf4569a on user Apr 13 18:56:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214767 Apr 13 18:56:47 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 31/91] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:56:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:47 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] validate_networks() for [('53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for project c162f91cba4b4ecf9de48fbf839da261. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for user df209814208d415e9d414d39205aaad6 and project c162f91cba4b4ecf9de48fbf839da261. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:56:48 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:56:48 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.412671 Apr 13 18:56:48 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 32/92] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:56:47 2023] POST /compute/v2.1/servers => generated 407 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:56:48 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f97cd75f-047e-470d-9e24-da3787232861 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:56:48 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f97cd75f-047e-470d-9e24-da3787232861 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:56:49 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-f97cd75f-047e-470d-9e24-da3787232861 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:56:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f97cd75f-047e-470d-9e24-da3787232861 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1231 microversion: 2.1 time: 0.410456 Apr 13 18:56:49 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 30/93] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:56:48 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1231 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:56:50 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-696e7709-1f9d-4919-9d40-ef4568020790 req-eb4fd218-e9bc-488d-8d99-f6fe5fcf0ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d32500-da20-4a99-af04-5f422ac6ba0a", "name": "network-vif-plugged", "status": "completed", "tag": "1572a520-f7d8-4a48-995e-9a83a99a41c8"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-696e7709-1f9d-4919-9d40-ef4568020790 req-eb4fd218-e9bc-488d-8d99-f6fe5fcf0ed5 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-696e7709-1f9d-4919-9d40-ef4568020790 req-eb4fd218-e9bc-488d-8d99-f6fe5fcf0ed5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-696e7709-1f9d-4919-9d40-ef4568020790 req-eb4fd218-e9bc-488d-8d99-f6fe5fcf0ed5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:50 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-696e7709-1f9d-4919-9d40-ef4568020790 req-eb4fd218-e9bc-488d-8d99-f6fe5fcf0ed5 service nova] Creating event network-vif-plugged:1572a520-f7d8-4a48-995e-9a83a99a41c8 for instance b7d32500-da20-4a99-af04-5f422ac6ba0a on user Apr 13 18:56:50 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-696e7709-1f9d-4919-9d40-ef4568020790 req-eb4fd218-e9bc-488d-8d99-f6fe5fcf0ed5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034595 Apr 13 18:56:50 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 32/94] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:56:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:50 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-plugged", "status": "completed", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:51 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] Creating event network-vif-plugged:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 18:56:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61587) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 18:56:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] Acquired lock "compute-rpcapi-router" {{(pid=61587) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 18:56:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53036043-a708-42a4-8cb7-e64cad8c8cfb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53036043-a708-42a4-8cb7-e64cad8c8cfb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53036043-a708-42a4-8cb7-e64cad8c8cfb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53036043-a708-42a4-8cb7-e64cad8c8cfb None None] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53036043-a708-42a4-8cb7-e64cad8c8cfb None None] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53036043-a708-42a4-8cb7-e64cad8c8cfb None None] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:51 user devstack@n-api.service[61587]: INFO nova.compute.rpcapi [None req-53036043-a708-42a4-8cb7-e64cad8c8cfb None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 18:56:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53036043-a708-42a4-8cb7-e64cad8c8cfb None None] Releasing lock "compute-rpcapi-router" {{(pid=61587) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 18:56:51 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-53036043-a708-42a4-8cb7-e64cad8c8cfb None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141815 Apr 13 18:56:51 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 33/95] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:56:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:52 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-6151c928-9988-4cd4-97ae-8c9e7268f7d7 req-d3c21d5d-166e-4024-9dd8-1e4016c08cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d32500-da20-4a99-af04-5f422ac6ba0a", "name": "network-vif-plugged", "status": "completed", "tag": "1572a520-f7d8-4a48-995e-9a83a99a41c8"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6151c928-9988-4cd4-97ae-8c9e7268f7d7 req-d3c21d5d-166e-4024-9dd8-1e4016c08cc2 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6151c928-9988-4cd4-97ae-8c9e7268f7d7 req-d3c21d5d-166e-4024-9dd8-1e4016c08cc2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6151c928-9988-4cd4-97ae-8c9e7268f7d7 req-d3c21d5d-166e-4024-9dd8-1e4016c08cc2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:52 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-6151c928-9988-4cd4-97ae-8c9e7268f7d7 req-d3c21d5d-166e-4024-9dd8-1e4016c08cc2 service nova] Creating event network-vif-plugged:1572a520-f7d8-4a48-995e-9a83a99a41c8 for instance b7d32500-da20-4a99-af04-5f422ac6ba0a on user Apr 13 18:56:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-6151c928-9988-4cd4-97ae-8c9e7268f7d7 req-d3c21d5d-166e-4024-9dd8-1e4016c08cc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068792 Apr 13 18:56:53 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 31/96] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:56:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:53 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:56:53 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-6b27f713-98bd-468c-b045-2e990cbe0684 req-78a3a887-6e40-4590-a4bf-55d13ef69906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-plugged", "status": "completed", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-6b27f713-98bd-468c-b045-2e990cbe0684 req-78a3a887-6e40-4590-a4bf-55d13ef69906 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-6b27f713-98bd-468c-b045-2e990cbe0684 req-78a3a887-6e40-4590-a4bf-55d13ef69906 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-6b27f713-98bd-468c-b045-2e990cbe0684 req-78a3a887-6e40-4590-a4bf-55d13ef69906 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:53 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-6b27f713-98bd-468c-b045-2e990cbe0684 req-78a3a887-6e40-4590-a4bf-55d13ef69906 service nova] Creating event network-vif-plugged:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 18:56:53 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-6b27f713-98bd-468c-b045-2e990cbe0684 req-78a3a887-6e40-4590-a4bf-55d13ef69906 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097686 Apr 13 18:56:53 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 33/97] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:56:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:54 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:54 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] Creating event network-changed:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 18:56:54 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081320 Apr 13 18:56:55 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 34/98] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:56:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:55 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:56:55 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17525a6-e377-4b33-85cd-88a7aaf4569a", "name": "network-vif-plugged", "status": "completed", "tag": "209c6974-cf54-4917-a9dc-2608f9eb10d9"}, {"name": "network-changed", "server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}, {"server_uuid": "f17525a6-e377-4b33-85cd-88a7aaf4569a", "name": "network-vif-plugged", "status": "completed", "tag": "209c6974-cf54-4917-a9dc-2608f9eb10d9"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:55 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Creating event network-vif-plugged:209c6974-cf54-4917-a9dc-2608f9eb10d9 for instance f17525a6-e377-4b33-85cd-88a7aaf4569a on user Apr 13 18:56:55 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Creating event network-changed:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 18:56:55 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Creating event network-vif-plugged:209c6974-cf54-4917-a9dc-2608f9eb10d9 for instance f17525a6-e377-4b33-85cd-88a7aaf4569a on user Apr 13 18:56:55 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.053782 Apr 13 18:56:55 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 32/99] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:56:55 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:58 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:56:58 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c4141438-952b-4a4c-a450-1c9711dbf4d8 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Action: 'create', calling method: .version_select at 0x7efe38d1f400>, body: {"keypair": {"name": "tempest-keypair-2099795213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNx53/4TAraZymj7hPrAueoIiB2h+tK9tJDIWTVO4FAoZl6flYUlpNu57v9Udep5R3j5i9IphipgPVjtpSkbuoKv5VddMP6Q71wMlIc9GvORV54fC9iVQJ3MPfVXY9S2Ow=="}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:58 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-c4141438-952b-4a4c-a450-1c9711dbf4d8 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Getting quotas for project 0d708f05aa7c454bbf94931b6b5593bf. Resources: {'key_pairs'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:56:58 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-c4141438-952b-4a4c-a450-1c9711dbf4d8 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Getting quotas for user 3e1ffe2f879f4c049b6c28d3a9623d14 and project 0d708f05aa7c454bbf94931b6b5593bf. Resources: {'key_pairs'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:56:58 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-c4141438-952b-4a4c-a450-1c9711dbf4d8 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.428263 Apr 13 18:56:58 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 34/100] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 18:56:58 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:56:59 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=22 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:56:59 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-f9360e49-5663-4c8f-ad33-845674736782 req-72c3225b-3f57-46fd-a63c-b036cbc60ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:56:59 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=10 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:56:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-f9360e49-5663-4c8f-ad33-845674736782 req-72c3225b-3f57-46fd-a63c-b036cbc60ef1 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:56:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-f9360e49-5663-4c8f-ad33-845674736782 req-72c3225b-3f57-46fd-a63c-b036cbc60ef1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:56:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-f9360e49-5663-4c8f-ad33-845674736782 req-72c3225b-3f57-46fd-a63c-b036cbc60ef1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:56:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-f9360e49-5663-4c8f-ad33-845674736782 req-72c3225b-3f57-46fd-a63c-b036cbc60ef1 service nova] Creating event network-vif-plugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 18:56:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-f9360e49-5663-4c8f-ad33-845674736782 req-72c3225b-3f57-46fd-a63c-b036cbc60ef1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086691 Apr 13 18:56:59 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 35/101] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:56:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:01 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=24 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:01 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}, {"server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "name": "network-vif-plugged", "status": "completed", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}, {"server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "name": "network-vif-plugged", "status": "completed", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:01 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=8 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:01 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=13 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:01 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Creating event network-vif-plugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 18:57:01 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Creating event network-vif-plugged:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 18:57:01 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Creating event network-vif-plugged:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 18:57:01 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.176859 Apr 13 18:57:01 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 33/102] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:01 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-970620856", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "99569b6e-2d6c-4e03-9971-462e962f316f"}], "security_groups": [{"name": "tempest-securitygroup--874795537"}], "key_name": "tempest-keypair-2099795213", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:01 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:02 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c92a0d1d-6822-4e81-b1da-9bbc5b47df07 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Action: 'create', calling method: .version_select at 0x7efe38d7b760>, body: {"keypair": {"name": "tempest-keypair-1173318920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOZw12y7JvN6iF5rvKpcO6rMNM7Ywi+ISHUKbndrEzQqj2J1+o6PLYpYgMYAzLmFd1Mu6qfqZLcgvarOntymA742YPlT0hQA2ze5D9iB8PHU56r5M+SfrjbYL32Z9e3dQ=="}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:02 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-c92a0d1d-6822-4e81-b1da-9bbc5b47df07 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Getting quotas for project a103d122466143fa96dabc7aec4c2b80. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:57:02 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-c92a0d1d-6822-4e81-b1da-9bbc5b47df07 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Getting quotas for user bfd7cd2f777f4101bc727349911ae5c3 and project a103d122466143fa96dabc7aec4c2b80. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:57:02 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-c92a0d1d-6822-4e81-b1da-9bbc5b47df07 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.423444 Apr 13 18:57:02 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 36/103] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 18:57:01 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:02 user devstack@n-api.service[61588]: DEBUG nova.network.neutron [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] validate_networks() for [('99569b6e-2d6c-4e03-9971-462e962f316f', None, None, None, None, None)] {{(pid=61588) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=10 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Flavor limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Image limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Flavor pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Image pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:04 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Getting quotas for project 0d708f05aa7c454bbf94931b6b5593bf. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:57:04 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Getting quotas for user 3e1ffe2f879f4c049b6c28d3a9623d14 and project 0d708f05aa7c454bbf94931b6b5593bf. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:57:04 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Going to run 1 instances... {{(pid=61588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:57:04 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:57:04 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.456709 Apr 13 18:57:04 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 35/104] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:57:01 2023] POST /compute/v2.1/servers => generated 403 bytes in 2459 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 13 18:57:04 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-3a542150-4991-45e7-8fd2-d843e4442715 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:57:04 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-3a542150-4991-45e7-8fd2-d843e4442715 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:57:04 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-3a542150-4991-45e7-8fd2-d843e4442715 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1ffe2f879f4c049b6c28d3a9623d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d708f05aa7c454bbf94931b6b5593bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:04 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-3a542150-4991-45e7-8fd2-d843e4442715 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61" status: 200 len: 1235 microversion: 2.1 time: 0.378315 Apr 13 18:57:04 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 34/105] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:57:04 2023] GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61 => generated 1235 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:57:06 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-725397932", "imageRef": "277fa2a8-beff-4b89-80f3-69462dbc910b", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7"}], "security_groups": [{"name": "tempest-securitygroup--1192353001"}], "key_name": "tempest-keypair-1173318920", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] validate_networks() for [('183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:57:07 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-326da565-a82a-4f18-8f29-1ef8dab1363f tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Action: 'create', calling method: .version_select at 0x7efe38d9a4d0>, body: {"keypair": {"name": "tempest-keypair-1823176268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIHybbKbv7HB+poxM5bK6awPxAExJljIECejrWYDmeSfQmp6wCacJOP/VGUPmj5NG5bAbHqNGkaAPI2nHiqHCKbFPdHWi6SSD7AEztbj0Dk/6ervAhiyZ1/5WcBBSR/7Q=="}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:07 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-326da565-a82a-4f18-8f29-1ef8dab1363f tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Getting quotas for project dc420cebeb8945cea96fe22173ad2b5b. Resources: {'key_pairs'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:57:07 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-326da565-a82a-4f18-8f29-1ef8dab1363f tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Getting quotas for user 3ff89f9a33e348e69d8a7e986100d421 and project dc420cebeb8945cea96fe22173ad2b5b. Resources: {'key_pairs'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:57:07 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-326da565-a82a-4f18-8f29-1ef8dab1363f tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109053 Apr 13 18:57:07 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 36/106] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 18:57:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Getting quotas for project a103d122466143fa96dabc7aec4c2b80. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Getting quotas for user bfd7cd2f777f4101bc727349911ae5c3 and project a103d122466143fa96dabc7aec4c2b80. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:57:07 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='277fa2a8-beff-4b89-80f3-69462dbc910b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:57:07 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.215184 Apr 13 18:57:07 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 37/107] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:57:06 2023] POST /compute/v2.1/servers => generated 404 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:57:08 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-0ad490e2-34f9-43fb-b048-d8c7dfe00b81 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:57:08 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-0ad490e2-34f9-43fb-b048-d8c7dfe00b81 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:57:08 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-0ad490e2-34f9-43fb-b048-d8c7dfe00b81 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd7cd2f777f4101bc727349911ae5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103d122466143fa96dabc7aec4c2b80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:08 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-0ad490e2-34f9-43fb-b048-d8c7dfe00b81 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0" status: 200 len: 1239 microversion: 2.1 time: 0.644938 Apr 13 18:57:08 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 35/108] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:57:07 2023] GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0 => generated 1239 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:57:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "106da0b9-c823-4f26-874c-53f8ad235e61", "tag": "8638d612-5f79-496f-8be2-db6706c14211"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] Creating event network-changed:8638d612-5f79-496f-8be2-db6706c14211 for instance 106da0b9-c823-4f26-874c-53f8ad235e61 on user Apr 13 18:57:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039615 Apr 13 18:57:09 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 37/109] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:10 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1559374833", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "c63ad37e-6185-435b-bc54-f9a888e474bd"}], "security_groups": [{"name": "tempest-securitygroup--1643009241"}], "key_name": "tempest-keypair-1823176268", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:10 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] validate_networks() for [('c63ad37e-6185-435b-bc54-f9a888e474bd', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Getting quotas for project dc420cebeb8945cea96fe22173ad2b5b. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Getting quotas for user 3ff89f9a33e348e69d8a7e986100d421 and project dc420cebeb8945cea96fe22173ad2b5b. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:57:11 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:57:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.072372 Apr 13 18:57:11 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 38/110] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:57:10 2023] POST /compute/v2.1/servers => generated 404 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:57:11 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-2d231b27-6b9d-41c9-acc4-60109ff3fbca tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:57:11 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-2d231b27-6b9d-41c9-acc4-60109ff3fbca tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:57:11 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-2d231b27-6b9d-41c9-acc4-60109ff3fbca tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff89f9a33e348e69d8a7e986100d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc420cebeb8945cea96fe22173ad2b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:11 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-2d231b27-6b9d-41c9-acc4-60109ff3fbca tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453" status: 200 len: 1226 microversion: 2.1 time: 0.082738 Apr 13 18:57:11 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 36/111] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:57:11 2023] GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 18:57:12 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed13b57-30a9-44c2-a18d-f936d33209b0", "tag": "e1757463-6986-4a9e-938a-9960bbe17cb9"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:12 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] Creating event network-changed:e1757463-6986-4a9e-938a-9960bbe17cb9 for instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 on user Apr 13 18:57:12 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038922 Apr 13 18:57:12 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 38/112] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:13 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-0ab1bc99-836a-44d7-8f2d-632b1920529f req-3851530f-32e8-47ec-875b-f155f781b2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "106da0b9-c823-4f26-874c-53f8ad235e61", "name": "network-vif-plugged", "status": "completed", "tag": "8638d612-5f79-496f-8be2-db6706c14211"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-0ab1bc99-836a-44d7-8f2d-632b1920529f req-3851530f-32e8-47ec-875b-f155f781b2d7 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-0ab1bc99-836a-44d7-8f2d-632b1920529f req-3851530f-32e8-47ec-875b-f155f781b2d7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-0ab1bc99-836a-44d7-8f2d-632b1920529f req-3851530f-32e8-47ec-875b-f155f781b2d7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:13 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=17 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:13 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-0ab1bc99-836a-44d7-8f2d-632b1920529f req-3851530f-32e8-47ec-875b-f155f781b2d7 service nova] Creating event network-vif-plugged:8638d612-5f79-496f-8be2-db6706c14211 for instance 106da0b9-c823-4f26-874c-53f8ad235e61 on user Apr 13 18:57:13 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-0ab1bc99-836a-44d7-8f2d-632b1920529f req-3851530f-32e8-47ec-875b-f155f781b2d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050548 Apr 13 18:57:13 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 39/113] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:15 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-647539e8-5b4d-4e22-ba19-399e9c55ac51 req-ce43f2a2-66b1-4f5f-96a5-6a0227b621a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "106da0b9-c823-4f26-874c-53f8ad235e61", "name": "network-vif-plugged", "status": "completed", "tag": "8638d612-5f79-496f-8be2-db6706c14211"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:15 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-647539e8-5b4d-4e22-ba19-399e9c55ac51 req-ce43f2a2-66b1-4f5f-96a5-6a0227b621a5 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-647539e8-5b4d-4e22-ba19-399e9c55ac51 req-ce43f2a2-66b1-4f5f-96a5-6a0227b621a5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-647539e8-5b4d-4e22-ba19-399e9c55ac51 req-ce43f2a2-66b1-4f5f-96a5-6a0227b621a5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-647539e8-5b4d-4e22-ba19-399e9c55ac51 req-ce43f2a2-66b1-4f5f-96a5-6a0227b621a5 service nova] Creating event network-vif-plugged:8638d612-5f79-496f-8be2-db6706c14211 for instance 106da0b9-c823-4f26-874c-53f8ad235e61 on user Apr 13 18:57:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-647539e8-5b4d-4e22-ba19-399e9c55ac51 req-ce43f2a2-66b1-4f5f-96a5-6a0227b621a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032662 Apr 13 18:57:15 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 37/114] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:16 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:16 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-c579179e-7149-49bf-9565-e151c931733b req-a00c08c3-174b-401f-b357-15ed8cc0e88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed13b57-30a9-44c2-a18d-f936d33209b0", "name": "network-vif-plugged", "status": "completed", "tag": "e1757463-6986-4a9e-938a-9960bbe17cb9"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-c579179e-7149-49bf-9565-e151c931733b req-a00c08c3-174b-401f-b357-15ed8cc0e88d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-c579179e-7149-49bf-9565-e151c931733b req-a00c08c3-174b-401f-b357-15ed8cc0e88d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-c579179e-7149-49bf-9565-e151c931733b req-a00c08c3-174b-401f-b357-15ed8cc0e88d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:16 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-c579179e-7149-49bf-9565-e151c931733b req-a00c08c3-174b-401f-b357-15ed8cc0e88d service nova] Creating event network-vif-plugged:e1757463-6986-4a9e-938a-9960bbe17cb9 for instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 on user Apr 13 18:57:16 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-c579179e-7149-49bf-9565-e151c931733b req-a00c08c3-174b-401f-b357-15ed8cc0e88d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071129 Apr 13 18:57:16 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 39/115] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:17 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570101b9-9c60-4c05-94ab-437a8a07d453", "tag": "3e432daf-10a6-4797-b1f8-ad67a2b8417f"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:17 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:17 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:17 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:17 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] Creating event network-changed:3e432daf-10a6-4797-b1f8-ad67a2b8417f for instance 570101b9-9c60-4c05-94ab-437a8a07d453 on user Apr 13 18:57:17 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045352 Apr 13 18:57:17 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 40/116] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:18 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-6fd62ec6-8a5f-479f-85c0-46588c89797a req-793e4c66-ff10-4d9a-b729-2f63e8d7aace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570101b9-9c60-4c05-94ab-437a8a07d453", "name": "network-vif-plugged", "status": "completed", "tag": "3e432daf-10a6-4797-b1f8-ad67a2b8417f"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6fd62ec6-8a5f-479f-85c0-46588c89797a req-793e4c66-ff10-4d9a-b729-2f63e8d7aace service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6fd62ec6-8a5f-479f-85c0-46588c89797a req-793e4c66-ff10-4d9a-b729-2f63e8d7aace service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6fd62ec6-8a5f-479f-85c0-46588c89797a req-793e4c66-ff10-4d9a-b729-2f63e8d7aace service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:18 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-6fd62ec6-8a5f-479f-85c0-46588c89797a req-793e4c66-ff10-4d9a-b729-2f63e8d7aace service nova] Creating event network-vif-plugged:3e432daf-10a6-4797-b1f8-ad67a2b8417f for instance 570101b9-9c60-4c05-94ab-437a8a07d453 on user Apr 13 18:57:18 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-6fd62ec6-8a5f-479f-85c0-46588c89797a req-793e4c66-ff10-4d9a-b729-2f63e8d7aace service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053263 Apr 13 18:57:18 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 38/117] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:57:18 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=14 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:18 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-fbe4897b-7763-44c8-bd87-f16c580470e9 req-342051f0-3b8d-4885-a069-7051cdd2a18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed13b57-30a9-44c2-a18d-f936d33209b0", "name": "network-vif-plugged", "status": "completed", "tag": "e1757463-6986-4a9e-938a-9960bbe17cb9"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-fbe4897b-7763-44c8-bd87-f16c580470e9 req-342051f0-3b8d-4885-a069-7051cdd2a18e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-fbe4897b-7763-44c8-bd87-f16c580470e9 req-342051f0-3b8d-4885-a069-7051cdd2a18e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-fbe4897b-7763-44c8-bd87-f16c580470e9 req-342051f0-3b8d-4885-a069-7051cdd2a18e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:18 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-fbe4897b-7763-44c8-bd87-f16c580470e9 req-342051f0-3b8d-4885-a069-7051cdd2a18e service nova] Creating event network-vif-plugged:e1757463-6986-4a9e-938a-9960bbe17cb9 for instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 on user Apr 13 18:57:18 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-fbe4897b-7763-44c8-bd87-f16c580470e9 req-342051f0-3b8d-4885-a069-7051cdd2a18e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061514 Apr 13 18:57:18 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 40/118] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-86b35525-a902-41b9-8042-f040264556d8 req-07287edb-4db9-4e17-8356-18ccdb9f8eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570101b9-9c60-4c05-94ab-437a8a07d453", "name": "network-vif-plugged", "status": "completed", "tag": "3e432daf-10a6-4797-b1f8-ad67a2b8417f"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-86b35525-a902-41b9-8042-f040264556d8 req-07287edb-4db9-4e17-8356-18ccdb9f8eb8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-86b35525-a902-41b9-8042-f040264556d8 req-07287edb-4db9-4e17-8356-18ccdb9f8eb8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-86b35525-a902-41b9-8042-f040264556d8 req-07287edb-4db9-4e17-8356-18ccdb9f8eb8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:20 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-86b35525-a902-41b9-8042-f040264556d8 req-07287edb-4db9-4e17-8356-18ccdb9f8eb8 service nova] Creating event network-vif-plugged:3e432daf-10a6-4797-b1f8-ad67a2b8417f for instance 570101b9-9c60-4c05-94ab-437a8a07d453 on user Apr 13 18:57:20 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-86b35525-a902-41b9-8042-f040264556d8 req-07287edb-4db9-4e17-8356-18ccdb9f8eb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050060 Apr 13 18:57:20 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 41/119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:23 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:23 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-0360c8c7-08d8-4ed1-bd58-8de551c35d5d tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:57:23 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-0360c8c7-08d8-4ed1-bd58-8de551c35d5d tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:57:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0360c8c7-08d8-4ed1-bd58-8de551c35d5d tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0360c8c7-08d8-4ed1-bd58-8de551c35d5d tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0360c8c7-08d8-4ed1-bd58-8de551c35d5d tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0360c8c7-08d8-4ed1-bd58-8de551c35d5d tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0360c8c7-08d8-4ed1-bd58-8de551c35d5d tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0360c8c7-08d8-4ed1-bd58-8de551c35d5d tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:23 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-0360c8c7-08d8-4ed1-bd58-8de551c35d5d tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1424be1648d4e8081f6a679b1407d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b577e81535534db29f5c81837949e958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-0360c8c7-08d8-4ed1-bd58-8de551c35d5d tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a" status: 200 len: 1489 microversion: 2.1 time: 0.384073 Apr 13 18:57:24 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 39/120] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:57:23 2023] GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a => generated 1489 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:57:26 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-3f521dbb-69c8-402e-b7bb-5859b641e266 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:57:26 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-3f521dbb-69c8-402e-b7bb-5859b641e266 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:57:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3f521dbb-69c8-402e-b7bb-5859b641e266 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3f521dbb-69c8-402e-b7bb-5859b641e266 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3f521dbb-69c8-402e-b7bb-5859b641e266 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3f521dbb-69c8-402e-b7bb-5859b641e266 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3f521dbb-69c8-402e-b7bb-5859b641e266 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3f521dbb-69c8-402e-b7bb-5859b641e266 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:26 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-3f521dbb-69c8-402e-b7bb-5859b641e266 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:26 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-3f521dbb-69c8-402e-b7bb-5859b641e266 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 200 len: 1537 microversion: 2.1 time: 0.346726 Apr 13 18:57:26 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 41/121] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:57:26 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 1537 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=16 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=7 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=5 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-97341ba7-6f90-4f9c-8640-1331290750f7 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-97341ba7-6f90-4f9c-8640-1331290750f7 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-97341ba7-6f90-4f9c-8640-1331290750f7 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-97341ba7-6f90-4f9c-8640-1331290750f7 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-97341ba7-6f90-4f9c-8640-1331290750f7 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-97341ba7-6f90-4f9c-8640-1331290750f7 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-97341ba7-6f90-4f9c-8640-1331290750f7 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-97341ba7-6f90-4f9c-8640-1331290750f7 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:32 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-97341ba7-6f90-4f9c-8640-1331290750f7 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7f76b4b7fb4651b3bce0e72f8a4de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1308cc4c5734de9a9fd83688c8da796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:32 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-97341ba7-6f90-4f9c-8640-1331290750f7 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a" status: 200 len: 1494 microversion: 2.1 time: 0.394437 Apr 13 18:57:32 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 42/122] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:57:32 2023] GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a => generated 1494 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e4e687f5-0b9b-41ad-a384-c3040339e73e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e4e687f5-0b9b-41ad-a384-c3040339e73e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=19 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=10 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e4e687f5-0b9b-41ad-a384-c3040339e73e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e4e687f5-0b9b-41ad-a384-c3040339e73e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e4e687f5-0b9b-41ad-a384-c3040339e73e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e4e687f5-0b9b-41ad-a384-c3040339e73e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e4e687f5-0b9b-41ad-a384-c3040339e73e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e4e687f5-0b9b-41ad-a384-c3040339e73e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-e4e687f5-0b9b-41ad-a384-c3040339e73e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-e4e687f5-0b9b-41ad-a384-c3040339e73e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:37 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-e4e687f5-0b9b-41ad-a384-c3040339e73e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:37 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e4e687f5-0b9b-41ad-a384-c3040339e73e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f" status: 200 len: 1586 microversion: 2.20 time: 0.240381 Apr 13 18:57:37 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 40/123] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:57:37 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f => generated 1586 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:57:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-9123e149-4ebe-403f-b45e-42cb0a4b7ce4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:57:39 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-9123e149-4ebe-403f-b45e-42cb0a4b7ce4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:57:39 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:39 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=16 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9123e149-4ebe-403f-b45e-42cb0a4b7ce4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9123e149-4ebe-403f-b45e-42cb0a4b7ce4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9123e149-4ebe-403f-b45e-42cb0a4b7ce4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9123e149-4ebe-403f-b45e-42cb0a4b7ce4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9123e149-4ebe-403f-b45e-42cb0a4b7ce4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9123e149-4ebe-403f-b45e-42cb0a4b7ce4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:39 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-9123e149-4ebe-403f-b45e-42cb0a4b7ce4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-9123e149-4ebe-403f-b45e-42cb0a4b7ce4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1537 microversion: 2.1 time: 0.205960 Apr 13 18:57:39 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 42/124] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:57:39 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1537 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:57:43 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-7b86c19f-5222-487d-9ac5-25a819b9ebf8 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Action: 'create', calling method: .version_select at 0x7efe38df01f0>, body: {"keypair": {"name": "tempest-keypair-2123184713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q=="}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:43 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:43 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:43 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-7b86c19f-5222-487d-9ac5-25a819b9ebf8 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Getting quotas for project 0e7c45edf2a84f86b4c91c12edb8c66a. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:57:43 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-7b86c19f-5222-487d-9ac5-25a819b9ebf8 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Getting quotas for user f63a7e8a5a374e66b26f2309874c5adb and project 0e7c45edf2a84f86b4c91c12edb8c66a. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:57:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-7b86c19f-5222-487d-9ac5-25a819b9ebf8 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.051551 Apr 13 18:57:43 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 43/125] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 18:57:43 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 18:57:45 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1372126936", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c"}, {"port": "7512b86a-c124-4ae8-907e-8490d9444e87", "tag": "port-1"}, {"port": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "tag": "port-2"}, {"uuid": "7e0f4926-cf1e-4cf9-b456-315821272683", "tag": "net-1"}, {"uuid": "7e0f4926-cf1e-4cf9-b456-315821272683"}, {"uuid": "5e734b04-2d73-42af-b120-2063ab3d7c85", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5e734b04-2d73-42af-b120-2063ab3d7c85", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "82b16cf4-0675-493a-ae28-0f0138b4a6a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "77537746-09dc-4379-b7d5-e17995736c65", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "75a05b92-4932-42a8-bd0b-ba98b157827a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--261216139"}], "key_name": "tempest-keypair-2123184713", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:45 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] validate_networks() for [('70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c', None, None, None, None, None), (None, None, '7512b86a-c124-4ae8-907e-8490d9444e87', None, None, None), (None, None, '624b1877-60ef-44ae-b9fa-c07cacb7fb72', None, None, None), ('7e0f4926-cf1e-4cf9-b456-315821272683', None, None, None, None, None), ('7e0f4926-cf1e-4cf9-b456-315821272683', None, None, None, None, None), ('5e734b04-2d73-42af-b120-2063ab3d7c85', '10.2.2.100', None, None, None, None), ('5e734b04-2d73-42af-b120-2063ab3d7c85', '10.2.2.200', None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Getting quotas for project 0e7c45edf2a84f86b4c91c12edb8c66a. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Getting quotas for user f63a7e8a5a374e66b26f2309874c5adb and project 0e7c45edf2a84f86b4c91c12edb8c66a. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:57:47 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='82b16cf4-0675-493a-ae28-0f0138b4a6a8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='77537746-09dc-4379-b7d5-e17995736c65',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='75a05b92-4932-42a8-bd0b-ba98b157827a',volume_size=None,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:57:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 2.563291 Apr 13 18:57:47 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 41/126] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 18:57:45 2023] POST /compute/v2.1/servers => generated 403 bytes in 2565 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 18:57:47 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c169274e-3c44-4dc0-88f0-3d0a51e3f91b tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:57:47 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-c169274e-3c44-4dc0-88f0-3d0a51e3f91b tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:57:47 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-c169274e-3c44-4dc0-88f0-3d0a51e3f91b tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:47 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-c169274e-3c44-4dc0-88f0-3d0a51e3f91b tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:47 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-c169274e-3c44-4dc0-88f0-3d0a51e3f91b tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-c169274e-3c44-4dc0-88f0-3d0a51e3f91b tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583" status: 200 len: 1280 microversion: 2.42 time: 0.076098 Apr 13 18:57:47 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 43/127] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:57:47 2023] GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583 => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:57:53 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "tag": "e45634b1-0f7f-4888-ae83-8567da56407d"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] Creating event network-changed:e45634b1-0f7f-4888-ae83-8567da56407d for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:57:53 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040790 Apr 13 18:57:53 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 44/128] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:54 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f7063869-a740-4066-ad40-0ca2fa7e40fa tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:57:54 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f7063869-a740-4066-ad40-0ca2fa7e40fa tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:57:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f7063869-a740-4066-ad40-0ca2fa7e40fa tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f7063869-a740-4066-ad40-0ca2fa7e40fa tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f7063869-a740-4066-ad40-0ca2fa7e40fa tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f7063869-a740-4066-ad40-0ca2fa7e40fa tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f7063869-a740-4066-ad40-0ca2fa7e40fa tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f7063869-a740-4066-ad40-0ca2fa7e40fa tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:54 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-f7063869-a740-4066-ad40-0ca2fa7e40fa tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1ffe2f879f4c049b6c28d3a9623d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d708f05aa7c454bbf94931b6b5593bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:54 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f7063869-a740-4066-ad40-0ca2fa7e40fa tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61" status: 200 len: 1544 microversion: 2.1 time: 0.225653 Apr 13 18:57:54 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 42/129] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:57:54 2023] GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61 => generated 1544 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:57:55 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "tag": "7512b86a-c124-4ae8-907e-8490d9444e87"}, {"name": "network-changed", "server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "tag": "624b1877-60ef-44ae-b9fa-c07cacb7fb72"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:55 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:55 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] Creating event network-changed:7512b86a-c124-4ae8-907e-8490d9444e87 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:57:55 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] Creating event network-changed:624b1877-60ef-44ae-b9fa-c07cacb7fb72 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:57:55 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031176 Apr 13 18:57:55 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 44/130] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:55 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:57 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "tag": "278cf193-9dcb-4703-b7d3-d3568a793952"}, {"name": "network-changed", "server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "tag": "0411f083-60b0-41d4-af75-a509ace59ad5"}, {"name": "network-changed", "server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "tag": "8f025dce-fc38-4414-8e60-c924fd38d5dd"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:57 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Creating event network-changed:278cf193-9dcb-4703-b7d3-d3568a793952 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:57:57 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Creating event network-changed:0411f083-60b0-41d4-af75-a509ace59ad5 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:57:57 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Creating event network-changed:8f025dce-fc38-4414-8e60-c924fd38d5dd for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:57:57 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.043553 Apr 13 18:57:57 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 45/131] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:57 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:57:58 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-1ff0cb4e-e24a-479d-8ac3-0ca2db7fb48f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:57:58 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-1ff0cb4e-e24a-479d-8ac3-0ca2db7fb48f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:57:58 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:58 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1ff0cb4e-e24a-479d-8ac3-0ca2db7fb48f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1ff0cb4e-e24a-479d-8ac3-0ca2db7fb48f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1ff0cb4e-e24a-479d-8ac3-0ca2db7fb48f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1ff0cb4e-e24a-479d-8ac3-0ca2db7fb48f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1ff0cb4e-e24a-479d-8ac3-0ca2db7fb48f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1ff0cb4e-e24a-479d-8ac3-0ca2db7fb48f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:58 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-1ff0cb4e-e24a-479d-8ac3-0ca2db7fb48f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd7cd2f777f4101bc727349911ae5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103d122466143fa96dabc7aec4c2b80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:57:58 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-1ff0cb4e-e24a-479d-8ac3-0ca2db7fb48f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0" status: 200 len: 1550 microversion: 2.1 time: 0.182092 Apr 13 18:57:58 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 43/132] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:57:58 2023] GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0 => generated 1550 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:57:59 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:57:59 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "tag": "50b51917-5a26-4a85-878a-7d21023a7fb1"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:57:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:57:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:57:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:57:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] Creating event network-changed:50b51917-5a26-4a85-878a-7d21023a7fb1 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:57:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032817 Apr 13 18:57:59 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 45/133] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:57:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-993e8964-c37c-4b87-9cde-233d4bbe8dc6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:01 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-993e8964-c37c-4b87-9cde-233d4bbe8dc6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-993e8964-c37c-4b87-9cde-233d4bbe8dc6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-993e8964-c37c-4b87-9cde-233d4bbe8dc6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-993e8964-c37c-4b87-9cde-233d4bbe8dc6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-993e8964-c37c-4b87-9cde-233d4bbe8dc6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-993e8964-c37c-4b87-9cde-233d4bbe8dc6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-993e8964-c37c-4b87-9cde-233d4bbe8dc6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:01 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-993e8964-c37c-4b87-9cde-233d4bbe8dc6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff89f9a33e348e69d8a7e986100d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc420cebeb8945cea96fe22173ad2b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:58:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-993e8964-c37c-4b87-9cde-233d4bbe8dc6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453" status: 200 len: 1525 microversion: 2.1 time: 0.218739 Apr 13 18:58:01 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 46/134] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:58:01 2023] GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453 => generated 1525 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:58:12 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-ab8a2dcf-7752-4d1a-be13-ec5b59ddfb02 req-f6a00873-7330-421d-afd9-e16137a2642f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "e45634b1-0f7f-4888-ae83-8567da56407d"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:12 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:12 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=20 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ab8a2dcf-7752-4d1a-be13-ec5b59ddfb02 req-f6a00873-7330-421d-afd9-e16137a2642f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ab8a2dcf-7752-4d1a-be13-ec5b59ddfb02 req-f6a00873-7330-421d-afd9-e16137a2642f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ab8a2dcf-7752-4d1a-be13-ec5b59ddfb02 req-f6a00873-7330-421d-afd9-e16137a2642f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-ab8a2dcf-7752-4d1a-be13-ec5b59ddfb02 req-f6a00873-7330-421d-afd9-e16137a2642f service nova] Creating event network-vif-plugged:e45634b1-0f7f-4888-ae83-8567da56407d for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-ab8a2dcf-7752-4d1a-be13-ec5b59ddfb02 req-f6a00873-7330-421d-afd9-e16137a2642f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063720 Apr 13 18:58:12 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 44/135] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:58:12 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=10 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:12 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:12 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-0f37185b-af6c-4f1e-9b37-8502d0f6685c req-e4017b9f-a7bd-4160-bcde-3d62adcdbab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "624b1877-60ef-44ae-b9fa-c07cacb7fb72"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0f37185b-af6c-4f1e-9b37-8502d0f6685c req-e4017b9f-a7bd-4160-bcde-3d62adcdbab2 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0f37185b-af6c-4f1e-9b37-8502d0f6685c req-e4017b9f-a7bd-4160-bcde-3d62adcdbab2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0f37185b-af6c-4f1e-9b37-8502d0f6685c req-e4017b9f-a7bd-4160-bcde-3d62adcdbab2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:12 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0f37185b-af6c-4f1e-9b37-8502d0f6685c req-e4017b9f-a7bd-4160-bcde-3d62adcdbab2 service nova] Creating event network-vif-plugged:624b1877-60ef-44ae-b9fa-c07cacb7fb72 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:12 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-0f37185b-af6c-4f1e-9b37-8502d0f6685c req-e4017b9f-a7bd-4160-bcde-3d62adcdbab2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032945 Apr 13 18:58:12 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 46/136] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:13 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-0c698cfe-634a-43f2-9898-2ecd35d60724 req-6583fff5-da76-42e5-86db-8ab72b51b1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "0411f083-60b0-41d4-af75-a509ace59ad5"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:13 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:13 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=10 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-0c698cfe-634a-43f2-9898-2ecd35d60724 req-6583fff5-da76-42e5-86db-8ab72b51b1ff service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-0c698cfe-634a-43f2-9898-2ecd35d60724 req-6583fff5-da76-42e5-86db-8ab72b51b1ff service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-0c698cfe-634a-43f2-9898-2ecd35d60724 req-6583fff5-da76-42e5-86db-8ab72b51b1ff service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:13 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-0c698cfe-634a-43f2-9898-2ecd35d60724 req-6583fff5-da76-42e5-86db-8ab72b51b1ff service nova] Creating event network-vif-plugged:0411f083-60b0-41d4-af75-a509ace59ad5 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:13 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-0c698cfe-634a-43f2-9898-2ecd35d60724 req-6583fff5-da76-42e5-86db-8ab72b51b1ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041042 Apr 13 18:58:13 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 47/137] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:14 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "e45634b1-0f7f-4888-ae83-8567da56407d"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "7512b86a-c124-4ae8-907e-8490d9444e87"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "7512b86a-c124-4ae8-907e-8490d9444e87"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:14 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Creating event network-vif-plugged:e45634b1-0f7f-4888-ae83-8567da56407d for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:14 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Creating event network-vif-plugged:7512b86a-c124-4ae8-907e-8490d9444e87 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:14 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Creating event network-vif-plugged:7512b86a-c124-4ae8-907e-8490d9444e87 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:14 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033453 Apr 13 18:58:14 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 45/138] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:14 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:58:14 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "624b1877-60ef-44ae-b9fa-c07cacb7fb72"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "278cf193-9dcb-4703-b7d3-d3568a793952"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "278cf193-9dcb-4703-b7d3-d3568a793952"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "50b51917-5a26-4a85-878a-7d21023a7fb1"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "50b51917-5a26-4a85-878a-7d21023a7fb1"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:14 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:14 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:14 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Creating event network-vif-plugged:624b1877-60ef-44ae-b9fa-c07cacb7fb72 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Creating event network-vif-plugged:278cf193-9dcb-4703-b7d3-d3568a793952 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Creating event network-vif-plugged:278cf193-9dcb-4703-b7d3-d3568a793952 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Creating event network-vif-plugged:50b51917-5a26-4a85-878a-7d21023a7fb1 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Creating event network-vif-plugged:50b51917-5a26-4a85-878a-7d21023a7fb1 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.034438 Apr 13 18:58:14 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 47/139] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:14 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:15 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "0411f083-60b0-41d4-af75-a509ace59ad5"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "8f025dce-fc38-4414-8e60-c924fd38d5dd"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "8f025dce-fc38-4414-8e60-c924fd38d5dd"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Creating event network-vif-plugged:0411f083-60b0-41d4-af75-a509ace59ad5 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Creating event network-vif-plugged:8f025dce-fc38-4414-8e60-c924fd38d5dd for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Creating event network-vif-plugged:8f025dce-fc38-4414-8e60-c924fd38d5dd for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:58:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033054 Apr 13 18:58:15 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 48/140] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:15 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09a3e062-a767-4145-ad2f-5e7e9dd0ed38"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:25 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:25 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:25 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:26 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379990 Apr 13 18:58:26 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 46/141] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:58:25 2023] POST /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:26 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:26 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:26 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0bfcc555-6566-4611-b936-b84ebb5dce5e tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:26 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-0bfcc555-6566-4611-b936-b84ebb5dce5e tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0bfcc555-6566-4611-b936-b84ebb5dce5e tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0bfcc555-6566-4611-b936-b84ebb5dce5e tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0bfcc555-6566-4611-b936-b84ebb5dce5e tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0bfcc555-6566-4611-b936-b84ebb5dce5e tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0bfcc555-6566-4611-b936-b84ebb5dce5e tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0bfcc555-6566-4611-b936-b84ebb5dce5e tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:26 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-0bfcc555-6566-4611-b936-b84ebb5dce5e tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.127795 Apr 13 18:58:26 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 48/142] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:58:26 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/os-interface => generated 282 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:27 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:27 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:27 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:27 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] Creating event network-changed:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 18:58:27 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033105 Apr 13 18:58:27 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 49/143] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:27 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-c261b99b-b4d0-44dc-a746-51732723f045 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:27 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-c261b99b-b4d0-44dc-a746-51732723f045 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c261b99b-b4d0-44dc-a746-51732723f045 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c261b99b-b4d0-44dc-a746-51732723f045 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c261b99b-b4d0-44dc-a746-51732723f045 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c261b99b-b4d0-44dc-a746-51732723f045 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c261b99b-b4d0-44dc-a746-51732723f045 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c261b99b-b4d0-44dc-a746-51732723f045 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:27 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-c261b99b-b4d0-44dc-a746-51732723f045 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/ips" status: 200 len: 104 microversion: 2.1 time: 0.041727 Apr 13 18:58:27 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 47/144] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 18:58:27 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/ips => generated 104 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:29 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0036a0d-e82a-4dee-b536-e4252af1ca02"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:29 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:29 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327165 Apr 13 18:58:29 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 49/145] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:58:29 2023] POST /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-987915062", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] validate_networks() for [('ae895ef0-18d7-4f77-bcc6-bcb3dd22026f', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Getting quotas for project a1308cc4c5734de9a9fd83688c8da796. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Getting quotas for user 3e7f76b4b7fb4651b3bce0e72f8a4de6 and project a1308cc4c5734de9a9fd83688c8da796. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:58:33 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:58:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.565526 Apr 13 18:58:33 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 50/146] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:58:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:58:33 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-84b1c805-0682-4271-ae4a-3177066091fe tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:33 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-84b1c805-0682-4271-ae4a-3177066091fe tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:33 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-84b1c805-0682-4271-ae4a-3177066091fe tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7f76b4b7fb4651b3bce0e72f8a4de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1308cc4c5734de9a9fd83688c8da796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:58:33 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-84b1c805-0682-4271-ae4a-3177066091fe tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" status: 200 len: 1210 microversion: 2.1 time: 0.066082 Apr 13 18:58:33 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 48/147] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:58:33 2023] GET /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb => generated 1210 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:58:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:34 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:34 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:58:35 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a" status: 204 len: 0 microversion: 2.1 time: 0.331552 Apr 13 18:58:35 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 50/148] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:58:34 2023] DELETE /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:58:35 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-4b7dd5f5-efd3-4b66-9501-30480af99be5 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:35 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-4b7dd5f5-efd3-4b66-9501-30480af99be5 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4b7dd5f5-efd3-4b66-9501-30480af99be5 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4b7dd5f5-efd3-4b66-9501-30480af99be5 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4b7dd5f5-efd3-4b66-9501-30480af99be5 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4b7dd5f5-efd3-4b66-9501-30480af99be5 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4b7dd5f5-efd3-4b66-9501-30480af99be5 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4b7dd5f5-efd3-4b66-9501-30480af99be5 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:35 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-a17b585e-4b84-4585-b439-a35fdd2313a7 req-b0250e61-03ae-4f6e-9ad9-f389377e0c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d32500-da20-4a99-af04-5f422ac6ba0a", "name": "network-vif-unplugged", "status": "completed", "tag": "1572a520-f7d8-4a48-995e-9a83a99a41c8"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:35 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-4b7dd5f5-efd3-4b66-9501-30480af99be5 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1424be1648d4e8081f6a679b1407d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b577e81535534db29f5c81837949e958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:58:35 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-4b7dd5f5-efd3-4b66-9501-30480af99be5 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a" status: 200 len: 1541 microversion: 2.1 time: 0.308647 Apr 13 18:58:35 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 51/149] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:58:35 2023] GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a => generated 1541 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:58:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a17b585e-4b84-4585-b439-a35fdd2313a7 req-b0250e61-03ae-4f6e-9ad9-f389377e0c24 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a17b585e-4b84-4585-b439-a35fdd2313a7 req-b0250e61-03ae-4f6e-9ad9-f389377e0c24 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a17b585e-4b84-4585-b439-a35fdd2313a7 req-b0250e61-03ae-4f6e-9ad9-f389377e0c24 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:35 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-a17b585e-4b84-4585-b439-a35fdd2313a7 req-b0250e61-03ae-4f6e-9ad9-f389377e0c24 service nova] Creating event network-vif-unplugged:1572a520-f7d8-4a48-995e-9a83a99a41c8 for instance b7d32500-da20-4a99-af04-5f422ac6ba0a on user Apr 13 18:58:35 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-a17b585e-4b84-4585-b439-a35fdd2313a7 req-b0250e61-03ae-4f6e-9ad9-f389377e0c24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.301600 Apr 13 18:58:35 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 49/150] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:36 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb", "tag": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:36 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] Creating event network-changed:6d3713a2-ef39-4f8b-964a-e4bcd4082bea for instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb on user Apr 13 18:58:36 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047998 Apr 13 18:58:36 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 51/151] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:37 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-530b5b7c-04ab-4f9a-944a-4daacb042121 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:37 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-530b5b7c-04ab-4f9a-944a-4daacb042121 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-530b5b7c-04ab-4f9a-944a-4daacb042121 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-530b5b7c-04ab-4f9a-944a-4daacb042121 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-530b5b7c-04ab-4f9a-944a-4daacb042121 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-530b5b7c-04ab-4f9a-944a-4daacb042121 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-530b5b7c-04ab-4f9a-944a-4daacb042121 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-530b5b7c-04ab-4f9a-944a-4daacb042121 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:37 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-530b5b7c-04ab-4f9a-944a-4daacb042121 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.181378 Apr 13 18:58:37 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 52/152] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 18:58:37 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/os-interface => generated 282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Going to try to stop instance {{(pid=61589) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 18:58:37 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/action" status: 202 len: 0 microversion: 2.1 time: 0.105981 Apr 13 18:58:37 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 50/153] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 18:58:37 2023] POST /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 18:58:37 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-5d18ec4b-1364-4be7-b9ef-691c05faab45 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:37 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-5d18ec4b-1364-4be7-b9ef-691c05faab45 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5d18ec4b-1364-4be7-b9ef-691c05faab45 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5d18ec4b-1364-4be7-b9ef-691c05faab45 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5d18ec4b-1364-4be7-b9ef-691c05faab45 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5d18ec4b-1364-4be7-b9ef-691c05faab45 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5d18ec4b-1364-4be7-b9ef-691c05faab45 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5d18ec4b-1364-4be7-b9ef-691c05faab45 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:37 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-857042e9-59e6-4116-9611-92eaccc94d25 req-c79ba749-0269-4051-8cf1-7b0d8699f5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d32500-da20-4a99-af04-5f422ac6ba0a", "name": "network-vif-plugged", "status": "completed", "tag": "1572a520-f7d8-4a48-995e-9a83a99a41c8"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-857042e9-59e6-4116-9611-92eaccc94d25 req-c79ba749-0269-4051-8cf1-7b0d8699f5d8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-857042e9-59e6-4116-9611-92eaccc94d25 req-c79ba749-0269-4051-8cf1-7b0d8699f5d8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-857042e9-59e6-4116-9611-92eaccc94d25 req-c79ba749-0269-4051-8cf1-7b0d8699f5d8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:37 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-857042e9-59e6-4116-9611-92eaccc94d25 req-c79ba749-0269-4051-8cf1-7b0d8699f5d8 service nova] Creating event network-vif-plugged:1572a520-f7d8-4a48-995e-9a83a99a41c8 for instance b7d32500-da20-4a99-af04-5f422ac6ba0a on user Apr 13 18:58:37 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-857042e9-59e6-4116-9611-92eaccc94d25 req-c79ba749-0269-4051-8cf1-7b0d8699f5d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065408 Apr 13 18:58:37 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 53/154] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:37 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-5d18ec4b-1364-4be7-b9ef-691c05faab45 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:58:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-5d18ec4b-1364-4be7-b9ef-691c05faab45 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 200 len: 1710 microversion: 2.1 time: 0.208483 Apr 13 18:58:37 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 52/155] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:58:37 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 1710 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-77777966-d27b-4bba-9208-fc5883ca9ceb tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-77777966-d27b-4bba-9208-fc5883ca9ceb tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-77777966-d27b-4bba-9208-fc5883ca9ceb tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-77777966-d27b-4bba-9208-fc5883ca9ceb tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-77777966-d27b-4bba-9208-fc5883ca9ceb tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-77777966-d27b-4bba-9208-fc5883ca9ceb tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-77777966-d27b-4bba-9208-fc5883ca9ceb tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-77777966-d27b-4bba-9208-fc5883ca9ceb tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:38 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-25cfe239-6b78-4fdf-842c-800ee7405d2a req-35bb6e49-e400-43b6-97ac-9e90210e6c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-unplugged", "status": "completed", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-25cfe239-6b78-4fdf-842c-800ee7405d2a req-35bb6e49-e400-43b6-97ac-9e90210e6c85 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-25cfe239-6b78-4fdf-842c-800ee7405d2a req-35bb6e49-e400-43b6-97ac-9e90210e6c85 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-25cfe239-6b78-4fdf-842c-800ee7405d2a req-35bb6e49-e400-43b6-97ac-9e90210e6c85 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:38 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-25cfe239-6b78-4fdf-842c-800ee7405d2a req-35bb6e49-e400-43b6-97ac-9e90210e6c85 service nova] Creating event network-vif-unplugged:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 18:58:38 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-25cfe239-6b78-4fdf-842c-800ee7405d2a req-35bb6e49-e400-43b6-97ac-9e90210e6c85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047164 Apr 13 18:58:38 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 54/156] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:38 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-77777966-d27b-4bba-9208-fc5883ca9ceb tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:58:38 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-77777966-d27b-4bba-9208-fc5883ca9ceb tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:58:38 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-77777966-d27b-4bba-9208-fc5883ca9ceb tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:58:38 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-77777966-d27b-4bba-9208-fc5883ca9ceb tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583" status: 200 len: 2822 microversion: 2.42 time: 0.309487 Apr 13 18:58:38 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 51/157] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:58:37 2023] GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583 => generated 2822 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:58:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-abcf9dc1-14f8-427a-839b-88c2ece646fd req-4be5ca27-ca13-4210-8040-e99389681c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb", "name": "network-vif-plugged", "status": "completed", "tag": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-abcf9dc1-14f8-427a-839b-88c2ece646fd req-4be5ca27-ca13-4210-8040-e99389681c57 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-abcf9dc1-14f8-427a-839b-88c2ece646fd req-4be5ca27-ca13-4210-8040-e99389681c57 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-abcf9dc1-14f8-427a-839b-88c2ece646fd req-4be5ca27-ca13-4210-8040-e99389681c57 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-abcf9dc1-14f8-427a-839b-88c2ece646fd req-4be5ca27-ca13-4210-8040-e99389681c57 service nova] Creating event network-vif-plugged:6d3713a2-ef39-4f8b-964a-e4bcd4082bea for instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb on user Apr 13 18:58:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-abcf9dc1-14f8-427a-839b-88c2ece646fd req-4be5ca27-ca13-4210-8040-e99389681c57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030329 Apr 13 18:58:39 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 53/158] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:39 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-dc9e8e67-06b2-40f9-a0fa-5bcb81485a27 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:39 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-dc9e8e67-06b2-40f9-a0fa-5bcb81485a27 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-dc9e8e67-06b2-40f9-a0fa-5bcb81485a27 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-dc9e8e67-06b2-40f9-a0fa-5bcb81485a27 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-dc9e8e67-06b2-40f9-a0fa-5bcb81485a27 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-dc9e8e67-06b2-40f9-a0fa-5bcb81485a27 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-dc9e8e67-06b2-40f9-a0fa-5bcb81485a27 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-dc9e8e67-06b2-40f9-a0fa-5bcb81485a27 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:39 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-177a4d64-09c7-4582-9b7c-8e208c0d1d54 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:39 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-177a4d64-09c7-4582-9b7c-8e208c0d1d54 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-177a4d64-09c7-4582-9b7c-8e208c0d1d54 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-177a4d64-09c7-4582-9b7c-8e208c0d1d54 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-177a4d64-09c7-4582-9b7c-8e208c0d1d54 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-177a4d64-09c7-4582-9b7c-8e208c0d1d54 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-177a4d64-09c7-4582-9b7c-8e208c0d1d54 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-177a4d64-09c7-4582-9b7c-8e208c0d1d54 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:39 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-dc9e8e67-06b2-40f9-a0fa-5bcb81485a27 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.133281 Apr 13 18:58:39 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 55/159] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:58:39 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-interface => generated 282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:39 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-177a4d64-09c7-4582-9b7c-8e208c0d1d54 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/ips" status: 200 len: 109 microversion: 2.20 time: 0.049743 Apr 13 18:58:39 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 52/160] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 18:58:39 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/ips => generated 109 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 18:58:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-dc2e33da-d2dd-497a-a849-f0388c262504 req-db1bc5c4-a3f8-4ef9-badf-6f31dcc40886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d32500-da20-4a99-af04-5f422ac6ba0a", "name": "network-vif-deleted", "tag": "1572a520-f7d8-4a48-995e-9a83a99a41c8"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-dc2e33da-d2dd-497a-a849-f0388c262504 req-db1bc5c4-a3f8-4ef9-badf-6f31dcc40886 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-dc2e33da-d2dd-497a-a849-f0388c262504 req-db1bc5c4-a3f8-4ef9-badf-6f31dcc40886 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-dc2e33da-d2dd-497a-a849-f0388c262504 req-db1bc5c4-a3f8-4ef9-badf-6f31dcc40886 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-dc2e33da-d2dd-497a-a849-f0388c262504 req-db1bc5c4-a3f8-4ef9-badf-6f31dcc40886 service nova] Creating event network-vif-deleted:1572a520-f7d8-4a48-995e-9a83a99a41c8 for instance b7d32500-da20-4a99-af04-5f422ac6ba0a on user Apr 13 18:58:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-dc2e33da-d2dd-497a-a849-f0388c262504 req-db1bc5c4-a3f8-4ef9-badf-6f31dcc40886 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038393 Apr 13 18:58:39 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 54/161] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:40 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-d2c1d410-0316-496f-ae35-eff14670be75 req-8412f89c-1ea3-4377-a47a-90422fff1754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-plugged", "status": "completed", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d2c1d410-0316-496f-ae35-eff14670be75 req-8412f89c-1ea3-4377-a47a-90422fff1754 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d2c1d410-0316-496f-ae35-eff14670be75 req-8412f89c-1ea3-4377-a47a-90422fff1754 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d2c1d410-0316-496f-ae35-eff14670be75 req-8412f89c-1ea3-4377-a47a-90422fff1754 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-d2c1d410-0316-496f-ae35-eff14670be75 req-8412f89c-1ea3-4377-a47a-90422fff1754 service nova] Creating event network-vif-plugged:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 18:58:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-d2c1d410-0316-496f-ae35-eff14670be75 req-8412f89c-1ea3-4377-a47a-90422fff1754 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044065 Apr 13 18:58:40 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 56/162] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:40 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-a5422656-2b98-4e34-9815-06e5489456ee tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:40 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-a5422656-2b98-4e34-9815-06e5489456ee tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a5422656-2b98-4e34-9815-06e5489456ee tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a5422656-2b98-4e34-9815-06e5489456ee tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a5422656-2b98-4e34-9815-06e5489456ee tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a5422656-2b98-4e34-9815-06e5489456ee tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a5422656-2b98-4e34-9815-06e5489456ee tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a5422656-2b98-4e34-9815-06e5489456ee tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:41 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-a5422656-2b98-4e34-9815-06e5489456ee tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:58:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-a5422656-2b98-4e34-9815-06e5489456ee tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1537 microversion: 2.1 time: 0.165098 Apr 13 18:58:41 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 53/163] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:58:40 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1537 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:58:41 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0b665174-23e1-463c-b2b1-bf3a343bc557 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:41 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-0b665174-23e1-463c-b2b1-bf3a343bc557 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0b665174-23e1-463c-b2b1-bf3a343bc557 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0b665174-23e1-463c-b2b1-bf3a343bc557 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0b665174-23e1-463c-b2b1-bf3a343bc557 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0b665174-23e1-463c-b2b1-bf3a343bc557 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0b665174-23e1-463c-b2b1-bf3a343bc557 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0b665174-23e1-463c-b2b1-bf3a343bc557 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:41 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-0b665174-23e1-463c-b2b1-bf3a343bc557 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:58:41 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-0b665174-23e1-463c-b2b1-bf3a343bc557 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1537 microversion: 2.1 time: 0.150707 Apr 13 18:58:41 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 55/164] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:58:41 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:58:41 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}, {"server_uuid": "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb", "name": "network-vif-plugged", "status": "completed", "tag": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:41 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] Creating event network-changed:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 18:58:41 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] Creating event network-vif-plugged:6d3713a2-ef39-4f8b-964a-e4bcd4082bea for instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb on user Apr 13 18:58:41 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049669 Apr 13 18:58:41 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 57/165] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:41 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:42 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:42 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:42 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] Creating event network-changed:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 18:58:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029793 Apr 13 18:58:42 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 56/166] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:42 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'flavor' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:58:43 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/action" status: 202 len: 0 microversion: 2.20 time: 0.867222 Apr 13 18:58:43 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 54/167] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 18:58:42 2023] POST /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/action => generated 0 bytes in 869 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:58:43 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-4a9e6728-cbff-4b03-b96b-f657ad5d56ee tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:43 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-4a9e6728-cbff-4b03-b96b-f657ad5d56ee tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4a9e6728-cbff-4b03-b96b-f657ad5d56ee tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4a9e6728-cbff-4b03-b96b-f657ad5d56ee tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4a9e6728-cbff-4b03-b96b-f657ad5d56ee tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4a9e6728-cbff-4b03-b96b-f657ad5d56ee tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4a9e6728-cbff-4b03-b96b-f657ad5d56ee tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4a9e6728-cbff-4b03-b96b-f657ad5d56ee tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:43 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-4a9e6728-cbff-4b03-b96b-f657ad5d56ee tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:58:43 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-4a9e6728-cbff-4b03-b96b-f657ad5d56ee tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:58:43 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-4a9e6728-cbff-4b03-b96b-f657ad5d56ee tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:58:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-4a9e6728-cbff-4b03-b96b-f657ad5d56ee tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f" status: 200 len: 1711 microversion: 2.20 time: 0.215115 Apr 13 18:58:43 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 58/168] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:58:43 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f => generated 1711 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:58:43 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-464e28ad-4fe3-48aa-8d72-25864b38f2ba req-e58c81e0-dca6-42a1-b064-c2d7c6d249a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "name": "network-vif-unplugged", "status": "completed", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-464e28ad-4fe3-48aa-8d72-25864b38f2ba req-e58c81e0-dca6-42a1-b064-c2d7c6d249a4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-464e28ad-4fe3-48aa-8d72-25864b38f2ba req-e58c81e0-dca6-42a1-b064-c2d7c6d249a4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-464e28ad-4fe3-48aa-8d72-25864b38f2ba req-e58c81e0-dca6-42a1-b064-c2d7c6d249a4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-464e28ad-4fe3-48aa-8d72-25864b38f2ba req-e58c81e0-dca6-42a1-b064-c2d7c6d249a4 service nova] Creating event network-vif-unplugged:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 18:58:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-464e28ad-4fe3-48aa-8d72-25864b38f2ba req-e58c81e0-dca6-42a1-b064-c2d7c6d249a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031575 Apr 13 18:58:43 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 57/169] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:45 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:45 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-45966dbf-3d1d-4578-9312-e72bbeab9656 req-52ba2407-11ca-4b4f-b187-95d6c545bab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "name": "network-vif-plugged", "status": "completed", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:45 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-45966dbf-3d1d-4578-9312-e72bbeab9656 req-52ba2407-11ca-4b4f-b187-95d6c545bab7 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:45 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-45966dbf-3d1d-4578-9312-e72bbeab9656 req-52ba2407-11ca-4b4f-b187-95d6c545bab7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:45 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-45966dbf-3d1d-4578-9312-e72bbeab9656 req-52ba2407-11ca-4b4f-b187-95d6c545bab7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:45 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-45966dbf-3d1d-4578-9312-e72bbeab9656 req-52ba2407-11ca-4b4f-b187-95d6c545bab7 service nova] Creating event network-vif-plugged:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 18:58:45 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-45966dbf-3d1d-4578-9312-e72bbeab9656 req-52ba2407-11ca-4b4f-b187-95d6c545bab7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035082 Apr 13 18:58:45 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 55/170] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:58:48 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:48 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:48 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:48 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] Creating event network-changed:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 18:58:48 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033258 Apr 13 18:58:48 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 59/171] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:54 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:54 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:54 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-90bbb769-a1d2-4405-aa01-61a55c0fd41f tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:54 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-90bbb769-a1d2-4405-aa01-61a55c0fd41f tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-90bbb769-a1d2-4405-aa01-61a55c0fd41f tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-90bbb769-a1d2-4405-aa01-61a55c0fd41f tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-90bbb769-a1d2-4405-aa01-61a55c0fd41f tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-90bbb769-a1d2-4405-aa01-61a55c0fd41f tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-90bbb769-a1d2-4405-aa01-61a55c0fd41f tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-90bbb769-a1d2-4405-aa01-61a55c0fd41f tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:55 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-90bbb769-a1d2-4405-aa01-61a55c0fd41f tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.094762 Apr 13 18:58:55 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 58/172] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:58:54 2023] GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-interface => generated 282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:55 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=22 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:55 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:58:55 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "106da0b9-c823-4f26-874c-53f8ad235e61", "tag": "8638d612-5f79-496f-8be2-db6706c14211"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:55 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] Creating event network-changed:8638d612-5f79-496f-8be2-db6706c14211 for instance 106da0b9-c823-4f26-874c-53f8ad235e61 on user Apr 13 18:58:55 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038509 Apr 13 18:58:55 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 56/173] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:57 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94e6e922-45be-46d6-92ee-5c3d6ebfcf7e"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:57 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:57 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "POST /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.540923 Apr 13 18:58:57 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 60/174] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:58:57 2023] POST /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:58 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a585d058-308f-43ec-ba04-c6dbabf341ca tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:58:58 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-a585d058-308f-43ec-ba04-c6dbabf341ca tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:58:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a585d058-308f-43ec-ba04-c6dbabf341ca tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a585d058-308f-43ec-ba04-c6dbabf341ca tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a585d058-308f-43ec-ba04-c6dbabf341ca tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a585d058-308f-43ec-ba04-c6dbabf341ca tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a585d058-308f-43ec-ba04-c6dbabf341ca tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a585d058-308f-43ec-ba04-c6dbabf341ca tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-a585d058-308f-43ec-ba04-c6dbabf341ca tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.085740 Apr 13 18:58:59 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 59/175] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:58:58 2023] GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0/os-interface => generated 283 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:58:59 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed13b57-30a9-44c2-a18d-f936d33209b0", "tag": "e1757463-6986-4a9e-938a-9960bbe17cb9"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:58:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:58:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:58:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:58:59 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] Creating event network-changed:e1757463-6986-4a9e-938a-9960bbe17cb9 for instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 on user Apr 13 18:58:59 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040395 Apr 13 18:58:59 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 57/176] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:58:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5189182b-ec00-4894-b2f7-19242b4860ed"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:01 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:01 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:01 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281779 Apr 13 18:59:01 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 61/177] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:59:01 2023] POST /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-eea63c3c-0c01-499e-8f65-970c56d19f8c tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:01 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-eea63c3c-0c01-499e-8f65-970c56d19f8c tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eea63c3c-0c01-499e-8f65-970c56d19f8c tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eea63c3c-0c01-499e-8f65-970c56d19f8c tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eea63c3c-0c01-499e-8f65-970c56d19f8c tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eea63c3c-0c01-499e-8f65-970c56d19f8c tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eea63c3c-0c01-499e-8f65-970c56d19f8c tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eea63c3c-0c01-499e-8f65-970c56d19f8c tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:01 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-eea63c3c-0c01-499e-8f65-970c56d19f8c tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.089595 Apr 13 18:59:01 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 60/178] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 18:59:01 2023] GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-interface => generated 282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:02 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570101b9-9c60-4c05-94ab-437a8a07d453", "tag": "3e432daf-10a6-4797-b1f8-ad67a2b8417f"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:02 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] Creating event network-changed:3e432daf-10a6-4797-b1f8-ad67a2b8417f for instance 570101b9-9c60-4c05-94ab-437a8a07d453 on user Apr 13 18:59:02 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030825 Apr 13 18:59:02 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 58/179] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:02 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:02 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "POST /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300414 Apr 13 18:59:03 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 62/180] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 18:59:02 2023] POST /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:59:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-907d9bc4-cdbf-428e-9c25-6cd5a174bb8e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "466d8904-21d0-436e-b081-e5565986b1c5"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:05 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-907d9bc4-cdbf-428e-9c25-6cd5a174bb8e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-907d9bc4-cdbf-428e-9c25-6cd5a174bb8e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-907d9bc4-cdbf-428e-9c25-6cd5a174bb8e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-907d9bc4-cdbf-428e-9c25-6cd5a174bb8e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-907d9bc4-cdbf-428e-9c25-6cd5a174bb8e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-907d9bc4-cdbf-428e-9c25-6cd5a174bb8e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-907d9bc4-cdbf-428e-9c25-6cd5a174bb8e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-907d9bc4-cdbf-428e-9c25-6cd5a174bb8e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] HTTP exception thrown: Volume 466d8904-21d0-436e-b081-e5565986b1c5 could not be found. Apr 13 18:59:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-907d9bc4-cdbf-428e-9c25-6cd5a174bb8e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Request method failure captured: Apr 13 18:59:05 user devstack@n-api.service[61588]: request: PUT /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-volume_attachments/94e6e922-45be-46d6-92ee-5c3d6ebfcf7e HTTP/1.1 Apr 13 18:59:05 user devstack@n-api.service[61588]: Accept: application/json Apr 13 18:59:05 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 18:59:05 user devstack@n-api.service[61588]: Connection: close Apr 13 18:59:05 user devstack@n-api.service[61588]: Content-Length: 74 Apr 13 18:59:05 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 18:59:05 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 18:59:05 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 18:59:05 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFB6laXF5juiTL92RqD2Jm8djcddv0WKhMRTHLSzN7ITIzRSmj8vODjhOm4gYe1o54ZyDCVwsVaqDP58eyiSGnPmkJjsinpvcE5gcUffKH3VKW6vXCXrPEnwd0dmV_DXYIOnDGS0y3mbpKhu8pBrYqmDL7nE9B8aggGIcsboy7vCdHw Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Project-Id: 8fa3eb8640204ca0b9f0e9af06123ba7 Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Project-Name: tempest-VolumesAdminNegativeTest-1148698299 Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Role: member,admin,reader Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Roles: member,admin,reader Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa3eb8640204ca0b9f0e9af06123ba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8fa3eb8640204ca0b9f0e9af06123ba7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa3eb8640204ca0b9f0e9af06123ba7"}]}] Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Tenant: tempest-VolumesAdminNegativeTest-1148698299 Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Tenant-Id: 8fa3eb8640204ca0b9f0e9af06123ba7 Apr 13 18:59:05 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1148698299 Apr 13 18:59:05 user devstack@n-api.service[61588]: X-User: tempest-VolumesAdminNegativeTest-1148698299-project-admin Apr 13 18:59:05 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 18:59:05 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 18:59:05 user devstack@n-api.service[61588]: X-User-Id: 3e977531fc2d4065b7761b969a02df97 Apr 13 18:59:05 user devstack@n-api.service[61588]: X-User-Name: tempest-VolumesAdminNegativeTest-1148698299-project-admin Apr 13 18:59:05 user devstack@n-api.service[61588]: Apr 13 18:59:05 user devstack@n-api.service[61588]: {"volumeAttachment": {"volumeId": "466d8904-21d0-436e-b081-e5565986b1c5"}} Apr 13 18:59:05 user devstack@n-api.service[61588]: method: > Apr 13 18:59:05 user devstack@n-api.service[61588]: exception: Volume 466d8904-21d0-436e-b081-e5565986b1c5 could not be found. Apr 13 18:59:05 user devstack@n-api.service[61588]: action_args: {'server_id': '106da0b9-c823-4f26-874c-53f8ad235e61', 'id': '94e6e922-45be-46d6-92ee-5c3d6ebfcf7e', 'body': {'volumeAttachment': {'volumeId': '466d8904-21d0-436e-b081-e5565986b1c5'}}} Apr 13 18:59:05 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 466d8904-21d0-436e-b081-e5565986b1c5 could not be found. (HTTP 404) (Request-ID: req-3996b266-1c3d-4dfe-935f-ba082490fa3f) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 466d8904-21d0-436e-b081-e5565986b1c5 could not be found. Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 466d8904-21d0-436e-b081-e5565986b1c5 could not be found. Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 466d8904-21d0-436e-b081-e5565986b1c5 could not be found. Apr 13 18:59:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-907d9bc4-cdbf-428e-9c25-6cd5a174bb8e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Returning 400 to user: Volume 466d8904-21d0-436e-b081-e5565986b1c5 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:59:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-907d9bc4-cdbf-428e-9c25-6cd5a174bb8e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-volume_attachments/94e6e922-45be-46d6-92ee-5c3d6ebfcf7e" status: 400 len: 107 microversion: 2.1 time: 0.344593 Apr 13 18:59:05 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 61/181] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 18:59:05 2023] PUT /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-volume_attachments/94e6e922-45be-46d6-92ee-5c3d6ebfcf7e => generated 107 bytes in 346 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:59:05 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:05 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:05 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lazy-loading 'services' on Instance uuid 106da0b9-c823-4f26-874c-53f8ad235e61 {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:59:05 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-volume_attachments/94e6e922-45be-46d6-92ee-5c3d6ebfcf7e" status: 202 len: 0 microversion: 2.1 time: 0.254334 Apr 13 18:59:05 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 59/182] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:59:05 2023] DELETE /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-volume_attachments/94e6e922-45be-46d6-92ee-5c3d6ebfcf7e => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:59:05 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-f31db73b-244f-4039-9398-c3ef99bfa4ed tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:05 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-f31db73b-244f-4039-9398-c3ef99bfa4ed tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f31db73b-244f-4039-9398-c3ef99bfa4ed tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f31db73b-244f-4039-9398-c3ef99bfa4ed tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f31db73b-244f-4039-9398-c3ef99bfa4ed tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f31db73b-244f-4039-9398-c3ef99bfa4ed tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f31db73b-244f-4039-9398-c3ef99bfa4ed tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f31db73b-244f-4039-9398-c3ef99bfa4ed tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:06 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-f31db73b-244f-4039-9398-c3ef99bfa4ed tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059660 Apr 13 18:59:06 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 63/183] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:59:05 2023] GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f339fda2-aec3-447d-a134-84081375bdb3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:09 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f339fda2-aec3-447d-a134-84081375bdb3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f339fda2-aec3-447d-a134-84081375bdb3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f339fda2-aec3-447d-a134-84081375bdb3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f339fda2-aec3-447d-a134-84081375bdb3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f339fda2-aec3-447d-a134-84081375bdb3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f339fda2-aec3-447d-a134-84081375bdb3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f339fda2-aec3-447d-a134-84081375bdb3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-f339fda2-aec3-447d-a134-84081375bdb3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047409 Apr 13 18:59:09 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 62/184] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:59:09 2023] GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:09 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:09 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:09 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lazy-loading 'services' on Instance uuid 0ed13b57-30a9-44c2-a18d-f936d33209b0 {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:59:09 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0/os-volume_attachments/5189182b-ec00-4894-b2f7-19242b4860ed" status: 202 len: 0 microversion: 2.1 time: 0.163188 Apr 13 18:59:09 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 60/185] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:59:09 2023] DELETE /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0/os-volume_attachments/5189182b-ec00-4894-b2f7-19242b4860ed => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:59:10 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ef58d148-d663-41c3-bfdd-6e769782a5f3"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:10 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:10 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments/ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a" status: 202 len: 0 microversion: 2.1 time: 0.435702 Apr 13 18:59:10 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 64/186] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 18:59:10 2023] PUT /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments/ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e30d01a4-f4cb-4af2-af84-54ed48ea5f2f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e30d01a4-f4cb-4af2-af84-54ed48ea5f2f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e30d01a4-f4cb-4af2-af84-54ed48ea5f2f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e30d01a4-f4cb-4af2-af84-54ed48ea5f2f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e30d01a4-f4cb-4af2-af84-54ed48ea5f2f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e30d01a4-f4cb-4af2-af84-54ed48ea5f2f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e30d01a4-f4cb-4af2-af84-54ed48ea5f2f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e30d01a4-f4cb-4af2-af84-54ed48ea5f2f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e30d01a4-f4cb-4af2-af84-54ed48ea5f2f tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044250 Apr 13 18:59:11 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 63/187] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:59:11 2023] GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:59:11 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-63cd3daf-5c2c-46e0-8a02-a9f6a51001b3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:11 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-63cd3daf-5c2c-46e0-8a02-a9f6a51001b3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-63cd3daf-5c2c-46e0-8a02-a9f6a51001b3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-63cd3daf-5c2c-46e0-8a02-a9f6a51001b3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-63cd3daf-5c2c-46e0-8a02-a9f6a51001b3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-63cd3daf-5c2c-46e0-8a02-a9f6a51001b3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-63cd3daf-5c2c-46e0-8a02-a9f6a51001b3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-63cd3daf-5c2c-46e0-8a02-a9f6a51001b3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:11 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-63cd3daf-5c2c-46e0-8a02-a9f6a51001b3 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046123 Apr 13 18:59:11 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 61/188] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:59:11 2023] GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:59:11 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:11 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:11 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:59:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0" status: 204 len: 0 microversion: 2.1 time: 0.177061 Apr 13 18:59:11 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 65/189] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:59:11 2023] DELETE /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ab467247-4a9b-4366-9039-68126b8ed660 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ab467247-4a9b-4366-9039-68126b8ed660 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ab467247-4a9b-4366-9039-68126b8ed660 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ab467247-4a9b-4366-9039-68126b8ed660 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ab467247-4a9b-4366-9039-68126b8ed660 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ab467247-4a9b-4366-9039-68126b8ed660 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ab467247-4a9b-4366-9039-68126b8ed660 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ab467247-4a9b-4366-9039-68126b8ed660 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:12 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-91ef4a0a-855e-4b64-b842-c61b3beeb0ee req-f2f710ea-0779-4a8c-afb5-0ed6a4204bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed13b57-30a9-44c2-a18d-f936d33209b0", "name": "network-vif-unplugged", "status": "completed", "tag": "e1757463-6986-4a9e-938a-9960bbe17cb9"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-91ef4a0a-855e-4b64-b842-c61b3beeb0ee req-f2f710ea-0779-4a8c-afb5-0ed6a4204bb6 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-91ef4a0a-855e-4b64-b842-c61b3beeb0ee req-f2f710ea-0779-4a8c-afb5-0ed6a4204bb6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-91ef4a0a-855e-4b64-b842-c61b3beeb0ee req-f2f710ea-0779-4a8c-afb5-0ed6a4204bb6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-91ef4a0a-855e-4b64-b842-c61b3beeb0ee req-f2f710ea-0779-4a8c-afb5-0ed6a4204bb6 service nova] Creating event network-vif-unplugged:e1757463-6986-4a9e-938a-9960bbe17cb9 for instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 on user Apr 13 18:59:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-91ef4a0a-855e-4b64-b842-c61b3beeb0ee req-f2f710ea-0779-4a8c-afb5-0ed6a4204bb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029593 Apr 13 18:59:12 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 62/190] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:12 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-ab467247-4a9b-4366-9039-68126b8ed660 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd7cd2f777f4101bc727349911ae5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103d122466143fa96dabc7aec4c2b80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:12 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-ab467247-4a9b-4366-9039-68126b8ed660 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0" status: 200 len: 1675 microversion: 2.1 time: 0.462934 Apr 13 18:59:12 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:59:11 2023] GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0 => generated 1675 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:59:14 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed13b57-30a9-44c2-a18d-f936d33209b0", "name": "network-vif-plugged", "status": "completed", "tag": "e1757463-6986-4a9e-938a-9960bbe17cb9"}, {"server_uuid": "0ed13b57-30a9-44c2-a18d-f936d33209b0", "name": "network-vif-deleted", "tag": "e1757463-6986-4a9e-938a-9960bbe17cb9"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:14 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] Creating event network-vif-plugged:e1757463-6986-4a9e-938a-9960bbe17cb9 for instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 on user Apr 13 18:59:14 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] Creating event network-vif-deleted:e1757463-6986-4a9e-938a-9960bbe17cb9 for instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 on user Apr 13 18:59:14 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031465 Apr 13 18:59:14 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 66/192] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:22 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=14 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:22 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:22 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-0cae0460-074a-41f2-9ca4-5dc613d7c2ac tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:22 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-0cae0460-074a-41f2-9ca4-5dc613d7c2ac tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0cae0460-074a-41f2-9ca4-5dc613d7c2ac tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0cae0460-074a-41f2-9ca4-5dc613d7c2ac tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0cae0460-074a-41f2-9ca4-5dc613d7c2ac tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0cae0460-074a-41f2-9ca4-5dc613d7c2ac tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0cae0460-074a-41f2-9ca4-5dc613d7c2ac tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0cae0460-074a-41f2-9ca4-5dc613d7c2ac tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:22 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-0cae0460-074a-41f2-9ca4-5dc613d7c2ac tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047118 Apr 13 18:59:22 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 63/193] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:59:22 2023] GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:22 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-3524fd29-5112-4bee-9ddc-bc6a6b0f4449 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:22 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-3524fd29-5112-4bee-9ddc-bc6a6b0f4449 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:22 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=14 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:22 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=34 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3524fd29-5112-4bee-9ddc-bc6a6b0f4449 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3524fd29-5112-4bee-9ddc-bc6a6b0f4449 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3524fd29-5112-4bee-9ddc-bc6a6b0f4449 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3524fd29-5112-4bee-9ddc-bc6a6b0f4449 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3524fd29-5112-4bee-9ddc-bc6a6b0f4449 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3524fd29-5112-4bee-9ddc-bc6a6b0f4449 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-3524fd29-5112-4bee-9ddc-bc6a6b0f4449 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Apr 13 18:59:22 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:59:22 2023] GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:22 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:22 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:23 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments/ef58d148-d663-41c3-bfdd-6e769782a5f3" status: 202 len: 0 microversion: 2.1 time: 0.265936 Apr 13 18:59:23 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 67/195] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 18:59:22 2023] PUT /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments/ef58d148-d663-41c3-bfdd-6e769782a5f3 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:59:23 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f56eb19d-4368-4903-947c-e0a1cc91c791 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:23 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f56eb19d-4368-4903-947c-e0a1cc91c791 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f56eb19d-4368-4903-947c-e0a1cc91c791 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f56eb19d-4368-4903-947c-e0a1cc91c791 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f56eb19d-4368-4903-947c-e0a1cc91c791 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f56eb19d-4368-4903-947c-e0a1cc91c791 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f56eb19d-4368-4903-947c-e0a1cc91c791 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f56eb19d-4368-4903-947c-e0a1cc91c791 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:23 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-f56eb19d-4368-4903-947c-e0a1cc91c791 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7f76b4b7fb4651b3bce0e72f8a4de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1308cc4c5734de9a9fd83688c8da796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f56eb19d-4368-4903-947c-e0a1cc91c791 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" status: 200 len: 1493 microversion: 2.1 time: 0.161337 Apr 13 18:59:23 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 64/196] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:59:23 2023] GET /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb => generated 1493 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:59:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f1bf5108-1233-4b8b-a7a7-398ef5f00f7b tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:25 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f1bf5108-1233-4b8b-a7a7-398ef5f00f7b tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f1bf5108-1233-4b8b-a7a7-398ef5f00f7b tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f1bf5108-1233-4b8b-a7a7-398ef5f00f7b tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f1bf5108-1233-4b8b-a7a7-398ef5f00f7b tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f1bf5108-1233-4b8b-a7a7-398ef5f00f7b tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f1bf5108-1233-4b8b-a7a7-398ef5f00f7b tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f1bf5108-1233-4b8b-a7a7-398ef5f00f7b tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-f1bf5108-1233-4b8b-a7a7-398ef5f00f7b tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] HTTP exception thrown: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f1bf5108-1233-4b8b-a7a7-398ef5f00f7b tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Request method failure captured: Apr 13 18:59:25 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a HTTP/1.1 Apr 13 18:59:25 user devstack@n-api.service[61588]: Accept: application/json Apr 13 18:59:25 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 18:59:25 user devstack@n-api.service[61588]: Connection: close Apr 13 18:59:25 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 18:59:25 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 18:59:25 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 18:59:25 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 18:59:25 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBe356LNm78OsWbJk02hqfgMLVTZPjzf_LY9HPHca0g-vIgyw7Gp7WKMBa5TLtNTUsLOnVDzIO4wrq3RAX61KMsguDN-Q5vaIEtujxBZpeftQ1DJM13q9QzumbkgYHGSzggPS3Kwg6wUyIw2-bN9e53Fp22UVwxdfN9h050x2YkQ7A Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Project-Id: b577e81535534db29f5c81837949e958 Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Project-Name: tempest-DeleteServersTestJSON-719282196 Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b577e81535534db29f5c81837949e958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b577e81535534db29f5c81837949e958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b577e81535534db29f5c81837949e958"}]}] Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Tenant: tempest-DeleteServersTestJSON-719282196 Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Tenant-Id: b577e81535534db29f5c81837949e958 Apr 13 18:59:25 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-DeleteServersTestJSON-719282196 Apr 13 18:59:25 user devstack@n-api.service[61588]: X-User: tempest-DeleteServersTestJSON-719282196-project-member Apr 13 18:59:25 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 18:59:25 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 18:59:25 user devstack@n-api.service[61588]: X-User-Id: c1424be1648d4e8081f6a679b1407d3a Apr 13 18:59:25 user devstack@n-api.service[61588]: X-User-Name: tempest-DeleteServersTestJSON-719282196-project-member Apr 13 18:59:25 user devstack@n-api.service[61588]: method: > Apr 13 18:59:25 user devstack@n-api.service[61588]: exception: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:25 user devstack@n-api.service[61588]: action_args: {'id': 'b7d32500-da20-4a99-af04-5f422ac6ba0a'} Apr 13 18:59:25 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f1bf5108-1233-4b8b-a7a7-398ef5f00f7b tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Returning 404 to user: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:59:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-f1bf5108-1233-4b8b-a7a7-398ef5f00f7b tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a" status: 404 len: 111 microversion: 2.1 time: 0.064410 Apr 13 18:59:25 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:59:25 2023] GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:59:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-12715383-b8c9-4754-9129-62d1282265a8 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:25 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-12715383-b8c9-4754-9129-62d1282265a8 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-12715383-b8c9-4754-9129-62d1282265a8 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-12715383-b8c9-4754-9129-62d1282265a8 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-12715383-b8c9-4754-9129-62d1282265a8 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-12715383-b8c9-4754-9129-62d1282265a8 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-12715383-b8c9-4754-9129-62d1282265a8 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-12715383-b8c9-4754-9129-62d1282265a8 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-12715383-b8c9-4754-9129-62d1282265a8 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] HTTP exception thrown: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-12715383-b8c9-4754-9129-62d1282265a8 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Request method failure captured: Apr 13 18:59:25 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a/os-volume_attachments HTTP/1.1 Apr 13 18:59:25 user devstack@n-api.service[61587]: Accept: application/json Apr 13 18:59:25 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 18:59:25 user devstack@n-api.service[61587]: Connection: close Apr 13 18:59:25 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 18:59:25 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 18:59:25 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 18:59:25 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 18:59:25 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBe356LNm78OsWbJk02hqfgMLVTZPjzf_LY9HPHca0g-vIgyw7Gp7WKMBa5TLtNTUsLOnVDzIO4wrq3RAX61KMsguDN-Q5vaIEtujxBZpeftQ1DJM13q9QzumbkgYHGSzggPS3Kwg6wUyIw2-bN9e53Fp22UVwxdfN9h050x2YkQ7A Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Project-Id: b577e81535534db29f5c81837949e958 Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Project-Name: tempest-DeleteServersTestJSON-719282196 Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b577e81535534db29f5c81837949e958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b577e81535534db29f5c81837949e958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b577e81535534db29f5c81837949e958"}]}] Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Tenant: tempest-DeleteServersTestJSON-719282196 Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Tenant-Id: b577e81535534db29f5c81837949e958 Apr 13 18:59:25 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-DeleteServersTestJSON-719282196 Apr 13 18:59:25 user devstack@n-api.service[61587]: X-User: tempest-DeleteServersTestJSON-719282196-project-member Apr 13 18:59:25 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 18:59:25 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 18:59:25 user devstack@n-api.service[61587]: X-User-Id: c1424be1648d4e8081f6a679b1407d3a Apr 13 18:59:25 user devstack@n-api.service[61587]: X-User-Name: tempest-DeleteServersTestJSON-719282196-project-member Apr 13 18:59:25 user devstack@n-api.service[61587]: method: > Apr 13 18:59:25 user devstack@n-api.service[61587]: exception: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:25 user devstack@n-api.service[61587]: action_args: {'server_id': 'b7d32500-da20-4a99-af04-5f422ac6ba0a'} Apr 13 18:59:25 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-12715383-b8c9-4754-9129-62d1282265a8 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Returning 404 to user: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:59:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-12715383-b8c9-4754-9129-62d1282265a8 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034498 Apr 13 18:59:25 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 68/198] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:59:25 2023] GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:59:27 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-17e95f28-d609-4f1f-b3c7-cdf48be6fdcb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:27 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-17e95f28-d609-4f1f-b3c7-cdf48be6fdcb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-17e95f28-d609-4f1f-b3c7-cdf48be6fdcb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-17e95f28-d609-4f1f-b3c7-cdf48be6fdcb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-17e95f28-d609-4f1f-b3c7-cdf48be6fdcb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-17e95f28-d609-4f1f-b3c7-cdf48be6fdcb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-17e95f28-d609-4f1f-b3c7-cdf48be6fdcb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-17e95f28-d609-4f1f-b3c7-cdf48be6fdcb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a73ee152-391c-495d-b1e8-197f6e2480fd tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:28 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-a73ee152-391c-495d-b1e8-197f6e2480fd tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a73ee152-391c-495d-b1e8-197f6e2480fd tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a73ee152-391c-495d-b1e8-197f6e2480fd tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a73ee152-391c-495d-b1e8-197f6e2480fd tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:28 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-17e95f28-d609-4f1f-b3c7-cdf48be6fdcb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a73ee152-391c-495d-b1e8-197f6e2480fd tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a73ee152-391c-495d-b1e8-197f6e2480fd tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a73ee152-391c-495d-b1e8-197f6e2480fd tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:28 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-17e95f28-d609-4f1f-b3c7-cdf48be6fdcb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 200 len: 1687 microversion: 2.1 time: 0.153925 Apr 13 18:59:28 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 65/199] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:59:27 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:59:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-a73ee152-391c-495d-b1e8-197f6e2480fd tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] HTTP exception thrown: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a73ee152-391c-495d-b1e8-197f6e2480fd tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Request method failure captured: Apr 13 18:59:28 user devstack@n-api.service[61588]: request: DELETE /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a HTTP/1.1 Apr 13 18:59:28 user devstack@n-api.service[61588]: Accept: application/json Apr 13 18:59:28 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 18:59:28 user devstack@n-api.service[61588]: Connection: close Apr 13 18:59:28 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 18:59:28 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 18:59:28 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 18:59:28 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 18:59:28 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBe356LNm78OsWbJk02hqfgMLVTZPjzf_LY9HPHca0g-vIgyw7Gp7WKMBa5TLtNTUsLOnVDzIO4wrq3RAX61KMsguDN-Q5vaIEtujxBZpeftQ1DJM13q9QzumbkgYHGSzggPS3Kwg6wUyIw2-bN9e53Fp22UVwxdfN9h050x2YkQ7A Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Project-Id: b577e81535534db29f5c81837949e958 Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Project-Name: tempest-DeleteServersTestJSON-719282196 Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b577e81535534db29f5c81837949e958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b577e81535534db29f5c81837949e958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b577e81535534db29f5c81837949e958"}]}] Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Tenant: tempest-DeleteServersTestJSON-719282196 Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Tenant-Id: b577e81535534db29f5c81837949e958 Apr 13 18:59:28 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-DeleteServersTestJSON-719282196 Apr 13 18:59:28 user devstack@n-api.service[61588]: X-User: tempest-DeleteServersTestJSON-719282196-project-member Apr 13 18:59:28 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 18:59:28 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 18:59:28 user devstack@n-api.service[61588]: X-User-Id: c1424be1648d4e8081f6a679b1407d3a Apr 13 18:59:28 user devstack@n-api.service[61588]: X-User-Name: tempest-DeleteServersTestJSON-719282196-project-member Apr 13 18:59:28 user devstack@n-api.service[61588]: method: > Apr 13 18:59:28 user devstack@n-api.service[61588]: exception: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:28 user devstack@n-api.service[61588]: action_args: {'id': 'b7d32500-da20-4a99-af04-5f422ac6ba0a'} Apr 13 18:59:28 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:28 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a73ee152-391c-495d-b1e8-197f6e2480fd tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Returning 404 to user: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:59:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-a73ee152-391c-495d-b1e8-197f6e2480fd tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a" status: 404 len: 111 microversion: 2.1 time: 0.045676 Apr 13 18:59:28 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 67/200] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 18:59:28 2023] DELETE /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:59:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-af8871e3-8fbf-41ea-94c4-9857786d9657 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:28 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-af8871e3-8fbf-41ea-94c4-9857786d9657 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-af8871e3-8fbf-41ea-94c4-9857786d9657 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-af8871e3-8fbf-41ea-94c4-9857786d9657 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-af8871e3-8fbf-41ea-94c4-9857786d9657 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-af8871e3-8fbf-41ea-94c4-9857786d9657 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-af8871e3-8fbf-41ea-94c4-9857786d9657 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-af8871e3-8fbf-41ea-94c4-9857786d9657 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-af8871e3-8fbf-41ea-94c4-9857786d9657 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] HTTP exception thrown: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-af8871e3-8fbf-41ea-94c4-9857786d9657 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Request method failure captured: Apr 13 18:59:28 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a HTTP/1.1 Apr 13 18:59:28 user devstack@n-api.service[61587]: Accept: application/json Apr 13 18:59:28 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 18:59:28 user devstack@n-api.service[61587]: Connection: close Apr 13 18:59:28 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 18:59:28 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 18:59:28 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 18:59:28 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 18:59:28 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBe356LNm78OsWbJk02hqfgMLVTZPjzf_LY9HPHca0g-vIgyw7Gp7WKMBa5TLtNTUsLOnVDzIO4wrq3RAX61KMsguDN-Q5vaIEtujxBZpeftQ1DJM13q9QzumbkgYHGSzggPS3Kwg6wUyIw2-bN9e53Fp22UVwxdfN9h050x2YkQ7A Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Project-Id: b577e81535534db29f5c81837949e958 Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Project-Name: tempest-DeleteServersTestJSON-719282196 Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b577e81535534db29f5c81837949e958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b577e81535534db29f5c81837949e958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b577e81535534db29f5c81837949e958"}]}] Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Tenant: tempest-DeleteServersTestJSON-719282196 Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Tenant-Id: b577e81535534db29f5c81837949e958 Apr 13 18:59:28 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-DeleteServersTestJSON-719282196 Apr 13 18:59:28 user devstack@n-api.service[61587]: X-User: tempest-DeleteServersTestJSON-719282196-project-member Apr 13 18:59:28 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 18:59:28 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 18:59:28 user devstack@n-api.service[61587]: X-User-Id: c1424be1648d4e8081f6a679b1407d3a Apr 13 18:59:28 user devstack@n-api.service[61587]: X-User-Name: tempest-DeleteServersTestJSON-719282196-project-member Apr 13 18:59:28 user devstack@n-api.service[61587]: method: > Apr 13 18:59:28 user devstack@n-api.service[61587]: exception: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:28 user devstack@n-api.service[61587]: action_args: {'id': 'b7d32500-da20-4a99-af04-5f422ac6ba0a'} Apr 13 18:59:28 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. Apr 13 18:59:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-af8871e3-8fbf-41ea-94c4-9857786d9657 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Returning 404 to user: Instance b7d32500-da20-4a99-af04-5f422ac6ba0a could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:59:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-af8871e3-8fbf-41ea-94c4-9857786d9657 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a" status: 404 len: 111 microversion: 2.1 time: 0.031180 Apr 13 18:59:28 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 69/201] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:59:28 2023] GET /compute/v2.1/servers/b7d32500-da20-4a99-af04-5f422ac6ba0a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:59:31 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fc24b652-1079-4193-9bcc-f2cedd4b6a77 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:31 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-fc24b652-1079-4193-9bcc-f2cedd4b6a77 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fc24b652-1079-4193-9bcc-f2cedd4b6a77 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fc24b652-1079-4193-9bcc-f2cedd4b6a77 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fc24b652-1079-4193-9bcc-f2cedd4b6a77 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fc24b652-1079-4193-9bcc-f2cedd4b6a77 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fc24b652-1079-4193-9bcc-f2cedd4b6a77 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fc24b652-1079-4193-9bcc-f2cedd4b6a77 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:31 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-fc24b652-1079-4193-9bcc-f2cedd4b6a77 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:31 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-fc24b652-1079-4193-9bcc-f2cedd4b6a77 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1654 microversion: 2.1 time: 0.298158 Apr 13 18:59:31 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 66/202] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:59:31 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1654 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:59:31 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4b8732bb-19a0-4602-95cd-29a08f7dbd37 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:31 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-4b8732bb-19a0-4602-95cd-29a08f7dbd37 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4b8732bb-19a0-4602-95cd-29a08f7dbd37 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4b8732bb-19a0-4602-95cd-29a08f7dbd37 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4b8732bb-19a0-4602-95cd-29a08f7dbd37 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4b8732bb-19a0-4602-95cd-29a08f7dbd37 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4b8732bb-19a0-4602-95cd-29a08f7dbd37 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4b8732bb-19a0-4602-95cd-29a08f7dbd37 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:31 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-4b8732bb-19a0-4602-95cd-29a08f7dbd37 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-4b8732bb-19a0-4602-95cd-29a08f7dbd37 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1654 microversion: 2.1 time: 0.303478 Apr 13 18:59:31 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 68/203] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:59:31 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1654 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-06c723fd-9d6d-4224-aed2-5ae7b7392cc1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-06c723fd-9d6d-4224-aed2-5ae7b7392cc1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-06c723fd-9d6d-4224-aed2-5ae7b7392cc1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-06c723fd-9d6d-4224-aed2-5ae7b7392cc1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-06c723fd-9d6d-4224-aed2-5ae7b7392cc1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-06c723fd-9d6d-4224-aed2-5ae7b7392cc1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-06c723fd-9d6d-4224-aed2-5ae7b7392cc1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-06c723fd-9d6d-4224-aed2-5ae7b7392cc1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-06c723fd-9d6d-4224-aed2-5ae7b7392cc1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-06c723fd-9d6d-4224-aed2-5ae7b7392cc1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:33 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-06c723fd-9d6d-4224-aed2-5ae7b7392cc1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-06c723fd-9d6d-4224-aed2-5ae7b7392cc1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f" status: 200 len: 1652 microversion: 2.20 time: 0.277676 Apr 13 18:59:33 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 70/204] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:59:33 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f => generated 1652 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 18:59:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7427ca88-606e-4feb-b787-edb138aedfa7 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Action: 'create', calling method: .version_select at 0x7efe382075b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-909912470", "metadata": {"Type": "work"}}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7427ca88-606e-4feb-b787-edb138aedfa7 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Request method failure captured: Apr 13 18:59:34 user devstack@n-api.service[61589]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 18:59:34 user devstack@n-api.service[61589]: Accept: application/json Apr 13 18:59:34 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 18:59:34 user devstack@n-api.service[61589]: Connection: close Apr 13 18:59:34 user devstack@n-api.service[61589]: Content-Length: 121 Apr 13 18:59:34 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 18:59:34 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 18:59:34 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 18:59:34 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFEWrgQe6vwUpqVz_W6RqT_MMl65Z8fXPLpHqBCz7UCCV6X9qqxZyKIxMCB9HAubwpw5SVauB9fbd24o2LFXnzdC2Rlr175RCGjZuN0sb6V-Bwl426MHFVB_106sRE88WNE9whoI2H6D9FVduQgeF_BkKrWkt8tJ_g6lVTa3iMvLQ6s Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Project-Id: 45a1741a0df141e093ca26db30fa355d Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Project-Name: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45a1741a0df141e093ca26db30fa355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45a1741a0df141e093ca26db30fa355d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45a1741a0df141e093ca26db30fa355d"}]}] Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Tenant: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Tenant-Id: 45a1741a0df141e093ca26db30fa355d Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User: tempest-VolumesNegativeTest-52533253-project-member Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User-Id: 8facdb302068461f9f338f7f450ecd00 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User-Name: tempest-VolumesNegativeTest-52533253-project-member Apr 13 18:59:34 user devstack@n-api.service[61589]: Apr 13 18:59:34 user devstack@n-api.service[61589]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-909912470", "metadata": {"Type": "work"}}} Apr 13 18:59:34 user devstack@n-api.service[61589]: method: Apr 13 18:59:34 user devstack@n-api.service[61589]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 18:59:34 user devstack@n-api.service[61589]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-909912470', 'metadata': {'Type': 'work'}}}} Apr 13 18:59:34 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise error Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi '#$%' Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7427ca88-606e-4feb-b787-edb138aedfa7 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:59:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7427ca88-606e-4feb-b787-edb138aedfa7 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.227034 Apr 13 18:59:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 67/205] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 18:59:34 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:59:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-17af4b15-17ec-46d8-8a71-dafb0ae4f0c1 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Action: 'create', calling method: .version_select at 0x7efe383d2200>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1002440178", "metadata": {"Type": "work"}}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-17af4b15-17ec-46d8-8a71-dafb0ae4f0c1 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Request method failure captured: Apr 13 18:59:34 user devstack@n-api.service[61588]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 18:59:34 user devstack@n-api.service[61588]: Accept: application/json Apr 13 18:59:34 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 18:59:34 user devstack@n-api.service[61588]: Connection: close Apr 13 18:59:34 user devstack@n-api.service[61588]: Content-Length: 120 Apr 13 18:59:34 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 18:59:34 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 18:59:34 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 18:59:34 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFEWrgQe6vwUpqVz_W6RqT_MMl65Z8fXPLpHqBCz7UCCV6X9qqxZyKIxMCB9HAubwpw5SVauB9fbd24o2LFXnzdC2Rlr175RCGjZuN0sb6V-Bwl426MHFVB_106sRE88WNE9whoI2H6D9FVduQgeF_BkKrWkt8tJ_g6lVTa3iMvLQ6s Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Project-Id: 45a1741a0df141e093ca26db30fa355d Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Project-Name: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45a1741a0df141e093ca26db30fa355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45a1741a0df141e093ca26db30fa355d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45a1741a0df141e093ca26db30fa355d"}]}] Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Tenant: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Tenant-Id: 45a1741a0df141e093ca26db30fa355d Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61588]: X-User: tempest-VolumesNegativeTest-52533253-project-member Apr 13 18:59:34 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 18:59:34 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 18:59:34 user devstack@n-api.service[61588]: X-User-Id: 8facdb302068461f9f338f7f450ecd00 Apr 13 18:59:34 user devstack@n-api.service[61588]: X-User-Name: tempest-VolumesNegativeTest-52533253-project-member Apr 13 18:59:34 user devstack@n-api.service[61588]: Apr 13 18:59:34 user devstack@n-api.service[61588]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1002440178", "metadata": {"Type": "work"}}} Apr 13 18:59:34 user devstack@n-api.service[61588]: method: Apr 13 18:59:34 user devstack@n-api.service[61588]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 18:59:34 user devstack@n-api.service[61588]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1002440178', 'metadata': {'Type': 'work'}}}} Apr 13 18:59:34 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise error Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi '0' Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-17af4b15-17ec-46d8-8a71-dafb0ae4f0c1 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:59:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-17af4b15-17ec-46d8-8a71-dafb0ae4f0c1 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012198 Apr 13 18:59:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 69/206] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 18:59:34 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:59:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c1976f36-7b07-41c1-833c-d4fb99480cd1 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Action: 'create', calling method: .version_select at 0x7efe3827cee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-379666990", "metadata": {"Type": "work"}}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c1976f36-7b07-41c1-833c-d4fb99480cd1 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Request method failure captured: Apr 13 18:59:34 user devstack@n-api.service[61587]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 18:59:34 user devstack@n-api.service[61587]: Accept: application/json Apr 13 18:59:34 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 18:59:34 user devstack@n-api.service[61587]: Connection: close Apr 13 18:59:34 user devstack@n-api.service[61587]: Content-Length: 118 Apr 13 18:59:34 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 18:59:34 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 18:59:34 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 18:59:34 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFEWrgQe6vwUpqVz_W6RqT_MMl65Z8fXPLpHqBCz7UCCV6X9qqxZyKIxMCB9HAubwpw5SVauB9fbd24o2LFXnzdC2Rlr175RCGjZuN0sb6V-Bwl426MHFVB_106sRE88WNE9whoI2H6D9FVduQgeF_BkKrWkt8tJ_g6lVTa3iMvLQ6s Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Project-Id: 45a1741a0df141e093ca26db30fa355d Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Project-Name: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45a1741a0df141e093ca26db30fa355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45a1741a0df141e093ca26db30fa355d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45a1741a0df141e093ca26db30fa355d"}]}] Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Tenant: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Tenant-Id: 45a1741a0df141e093ca26db30fa355d Apr 13 18:59:34 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61587]: X-User: tempest-VolumesNegativeTest-52533253-project-member Apr 13 18:59:34 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 18:59:34 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 18:59:34 user devstack@n-api.service[61587]: X-User-Id: 8facdb302068461f9f338f7f450ecd00 Apr 13 18:59:34 user devstack@n-api.service[61587]: X-User-Name: tempest-VolumesNegativeTest-52533253-project-member Apr 13 18:59:34 user devstack@n-api.service[61587]: Apr 13 18:59:34 user devstack@n-api.service[61587]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-379666990", "metadata": {"Type": "work"}}} Apr 13 18:59:34 user devstack@n-api.service[61587]: method: Apr 13 18:59:34 user devstack@n-api.service[61587]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 18:59:34 user devstack@n-api.service[61587]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-379666990', 'metadata': {'Type': 'work'}}}} Apr 13 18:59:34 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise error Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi '' Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 18:59:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c1976f36-7b07-41c1-833c-d4fb99480cd1 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:59:34 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-c1976f36-7b07-41c1-833c-d4fb99480cd1 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009993 Apr 13 18:59:34 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 71/207] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 18:59:34 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 18:59:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fabcfa4d-9c40-4fcc-a450-0b84173ffd53 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Calling method '.version_select at 0x7efe38141e10>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-fabcfa4d-9c40-4fcc-a450-0b84173ffd53 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] HTTP exception thrown: Volume tempest-invalid-1437924500 could not be found. Apr 13 18:59:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fabcfa4d-9c40-4fcc-a450-0b84173ffd53 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Request method failure captured: Apr 13 18:59:34 user devstack@n-api.service[61589]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1437924500 HTTP/1.1 Apr 13 18:59:34 user devstack@n-api.service[61589]: Accept: application/json Apr 13 18:59:34 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 18:59:34 user devstack@n-api.service[61589]: Connection: close Apr 13 18:59:34 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 18:59:34 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 18:59:34 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 18:59:34 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 18:59:34 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFEWrgQe6vwUpqVz_W6RqT_MMl65Z8fXPLpHqBCz7UCCV6X9qqxZyKIxMCB9HAubwpw5SVauB9fbd24o2LFXnzdC2Rlr175RCGjZuN0sb6V-Bwl426MHFVB_106sRE88WNE9whoI2H6D9FVduQgeF_BkKrWkt8tJ_g6lVTa3iMvLQ6s Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Project-Id: 45a1741a0df141e093ca26db30fa355d Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Project-Name: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45a1741a0df141e093ca26db30fa355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45a1741a0df141e093ca26db30fa355d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45a1741a0df141e093ca26db30fa355d"}]}] Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Tenant: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Tenant-Id: 45a1741a0df141e093ca26db30fa355d Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User: tempest-VolumesNegativeTest-52533253-project-member Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User-Id: 8facdb302068461f9f338f7f450ecd00 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User-Name: tempest-VolumesNegativeTest-52533253-project-member Apr 13 18:59:34 user devstack@n-api.service[61589]: method: Apr 13 18:59:34 user devstack@n-api.service[61589]: exception: Volume tempest-invalid-1437924500 could not be found. Apr 13 18:59:34 user devstack@n-api.service[61589]: action_args: {'id': 'tempest-invalid-1437924500'} Apr 13 18:59:34 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1437924500 could not be found. (HTTP 404) (Request-ID: req-585c7ddc-cad2-4b3b-bb1f-ae9ffa677122) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1437924500 could not be found. Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1437924500 could not be found. Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1437924500 could not be found. Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fabcfa4d-9c40-4fcc-a450-0b84173ffd53 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Returning 404 to user: Volume tempest-invalid-1437924500 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:59:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-fabcfa4d-9c40-4fcc-a450-0b84173ffd53 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1437924500" status: 404 len: 99 microversion: 2.1 time: 0.043271 Apr 13 18:59:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 68/208] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 18:59:34 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1437924500 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 13 18:59:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-fa633270-9fcd-4b95-9e3d-823d7395ac9c tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004483 Apr 13 18:59:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 70/209] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 18:59:34 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 18:59:34 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-1682e1c9-18dd-4b9d-b471-efe3ca8ee90e tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004308 Apr 13 18:59:34 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 72/210] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 13 18:59:34 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 18:59:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-eb3a50a7-fcfe-4cfc-964b-6f7004c9b354 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Calling method '.version_select at 0x7efe38205cf0>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-eb3a50a7-fcfe-4cfc-964b-6f7004c9b354 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] HTTP exception thrown: Volume ccc7d115-67b6-43d1-ab79-2c5b61006d0c could not be found. Apr 13 18:59:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-eb3a50a7-fcfe-4cfc-964b-6f7004c9b354 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Request method failure captured: Apr 13 18:59:34 user devstack@n-api.service[61589]: request: DELETE /compute/v2.1/os-volumes/ccc7d115-67b6-43d1-ab79-2c5b61006d0c HTTP/1.1 Apr 13 18:59:34 user devstack@n-api.service[61589]: Accept: application/json Apr 13 18:59:34 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 18:59:34 user devstack@n-api.service[61589]: Connection: close Apr 13 18:59:34 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 18:59:34 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 18:59:34 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 18:59:34 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 18:59:34 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFEWrgQe6vwUpqVz_W6RqT_MMl65Z8fXPLpHqBCz7UCCV6X9qqxZyKIxMCB9HAubwpw5SVauB9fbd24o2LFXnzdC2Rlr175RCGjZuN0sb6V-Bwl426MHFVB_106sRE88WNE9whoI2H6D9FVduQgeF_BkKrWkt8tJ_g6lVTa3iMvLQ6s Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Project-Id: 45a1741a0df141e093ca26db30fa355d Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Project-Name: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45a1741a0df141e093ca26db30fa355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45a1741a0df141e093ca26db30fa355d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45a1741a0df141e093ca26db30fa355d"}]}] Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Tenant: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Tenant-Id: 45a1741a0df141e093ca26db30fa355d Apr 13 18:59:34 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User: tempest-VolumesNegativeTest-52533253-project-member Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User-Id: 8facdb302068461f9f338f7f450ecd00 Apr 13 18:59:34 user devstack@n-api.service[61589]: X-User-Name: tempest-VolumesNegativeTest-52533253-project-member Apr 13 18:59:34 user devstack@n-api.service[61589]: method: Apr 13 18:59:34 user devstack@n-api.service[61589]: exception: Volume ccc7d115-67b6-43d1-ab79-2c5b61006d0c could not be found. Apr 13 18:59:34 user devstack@n-api.service[61589]: action_args: {'id': 'ccc7d115-67b6-43d1-ab79-2c5b61006d0c'} Apr 13 18:59:34 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ccc7d115-67b6-43d1-ab79-2c5b61006d0c could not be found. (HTTP 404) (Request-ID: req-8598c816-4888-408e-b57c-1b34f99024f1) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ccc7d115-67b6-43d1-ab79-2c5b61006d0c could not be found. Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ccc7d115-67b6-43d1-ab79-2c5b61006d0c could not be found. Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ccc7d115-67b6-43d1-ab79-2c5b61006d0c could not be found. Apr 13 18:59:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-eb3a50a7-fcfe-4cfc-964b-6f7004c9b354 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Returning 404 to user: Volume ccc7d115-67b6-43d1-ab79-2c5b61006d0c could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:59:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-eb3a50a7-fcfe-4cfc-964b-6f7004c9b354 tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/ccc7d115-67b6-43d1-ab79-2c5b61006d0c" status: 404 len: 109 microversion: 2.1 time: 0.033757 Apr 13 18:59:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 69/211] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 18:59:34 2023] DELETE /compute/v2.1/os-volumes/ccc7d115-67b6-43d1-ab79-2c5b61006d0c => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 18:59:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-7e277917-19f7-4a66-859a-140cd731997b tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Calling method '.version_select at 0x7efe382209d0>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-7e277917-19f7-4a66-859a-140cd731997b tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] HTTP exception thrown: Volume 18314245-4705-4997-90de-003c999331b3 could not be found. Apr 13 18:59:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-7e277917-19f7-4a66-859a-140cd731997b tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Request method failure captured: Apr 13 18:59:34 user devstack@n-api.service[61588]: request: GET /compute/v2.1/os-volumes/18314245-4705-4997-90de-003c999331b3 HTTP/1.1 Apr 13 18:59:34 user devstack@n-api.service[61588]: Accept: application/json Apr 13 18:59:34 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 18:59:34 user devstack@n-api.service[61588]: Connection: close Apr 13 18:59:34 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 18:59:34 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 18:59:34 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 18:59:34 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 18:59:34 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFEWrgQe6vwUpqVz_W6RqT_MMl65Z8fXPLpHqBCz7UCCV6X9qqxZyKIxMCB9HAubwpw5SVauB9fbd24o2LFXnzdC2Rlr175RCGjZuN0sb6V-Bwl426MHFVB_106sRE88WNE9whoI2H6D9FVduQgeF_BkKrWkt8tJ_g6lVTa3iMvLQ6s Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Project-Id: 45a1741a0df141e093ca26db30fa355d Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Project-Name: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45a1741a0df141e093ca26db30fa355d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45a1741a0df141e093ca26db30fa355d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45a1741a0df141e093ca26db30fa355d"}]}] Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Tenant: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Tenant-Id: 45a1741a0df141e093ca26db30fa355d Apr 13 18:59:34 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-VolumesNegativeTest-52533253 Apr 13 18:59:34 user devstack@n-api.service[61588]: X-User: tempest-VolumesNegativeTest-52533253-project-member Apr 13 18:59:34 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 18:59:34 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 18:59:34 user devstack@n-api.service[61588]: X-User-Id: 8facdb302068461f9f338f7f450ecd00 Apr 13 18:59:34 user devstack@n-api.service[61588]: X-User-Name: tempest-VolumesNegativeTest-52533253-project-member Apr 13 18:59:34 user devstack@n-api.service[61588]: method: Apr 13 18:59:34 user devstack@n-api.service[61588]: exception: Volume 18314245-4705-4997-90de-003c999331b3 could not be found. Apr 13 18:59:34 user devstack@n-api.service[61588]: action_args: {'id': '18314245-4705-4997-90de-003c999331b3'} Apr 13 18:59:34 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18314245-4705-4997-90de-003c999331b3 could not be found. (HTTP 404) (Request-ID: req-a8ffbcf7-9d4f-4cb2-a4bf-9cb648469387) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18314245-4705-4997-90de-003c999331b3 could not be found. Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18314245-4705-4997-90de-003c999331b3 could not be found. Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18314245-4705-4997-90de-003c999331b3 could not be found. Apr 13 18:59:34 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 18:59:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-7e277917-19f7-4a66-859a-140cd731997b tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] Returning 404 to user: Volume 18314245-4705-4997-90de-003c999331b3 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 18:59:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-7e277917-19f7-4a66-859a-140cd731997b tempest-VolumesNegativeTest-52533253 tempest-VolumesNegativeTest-52533253-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/18314245-4705-4997-90de-003c999331b3" status: 404 len: 109 microversion: 2.1 time: 0.033467 Apr 13 18:59:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 71/212] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 18:59:34 2023] GET /compute/v2.1/os-volumes/18314245-4705-4997-90de-003c999331b3 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0819eba5-6afe-4672-abd7-9f7e024d2bb6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-0819eba5-6afe-4672-abd7-9f7e024d2bb6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0819eba5-6afe-4672-abd7-9f7e024d2bb6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0819eba5-6afe-4672-abd7-9f7e024d2bb6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0819eba5-6afe-4672-abd7-9f7e024d2bb6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0819eba5-6afe-4672-abd7-9f7e024d2bb6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0819eba5-6afe-4672-abd7-9f7e024d2bb6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0819eba5-6afe-4672-abd7-9f7e024d2bb6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:35 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-0819eba5-6afe-4672-abd7-9f7e024d2bb6 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049844 Apr 13 18:59:35 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 73/213] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:59:35 2023] GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:35 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-6928e89d-fa96-4172-84c7-6eefe6491876 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:35 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-6928e89d-fa96-4172-84c7-6eefe6491876 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6928e89d-fa96-4172-84c7-6eefe6491876 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6928e89d-fa96-4172-84c7-6eefe6491876 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6928e89d-fa96-4172-84c7-6eefe6491876 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6928e89d-fa96-4172-84c7-6eefe6491876 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6928e89d-fa96-4172-84c7-6eefe6491876 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6928e89d-fa96-4172-84c7-6eefe6491876 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:35 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-6928e89d-fa96-4172-84c7-6eefe6491876 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Apr 13 18:59:35 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 70/214] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:59:35 2023] GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:35 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:35 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:35 user devstack@n-api.service[61588]: DEBUG nova.objects.instance [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lazy-loading 'services' on Instance uuid 570101b9-9c60-4c05-94ab-437a8a07d453 {{(pid=61588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 18:59:35 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments/ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a" status: 202 len: 0 microversion: 2.1 time: 0.266162 Apr 13 18:59:35 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 72/215] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 18:59:35 2023] DELETE /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments/ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1581e554-e736-4809-9dd2-809343f87cf5 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-1581e554-e736-4809-9dd2-809343f87cf5 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1581e554-e736-4809-9dd2-809343f87cf5 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1581e554-e736-4809-9dd2-809343f87cf5 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1581e554-e736-4809-9dd2-809343f87cf5 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1581e554-e736-4809-9dd2-809343f87cf5 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1581e554-e736-4809-9dd2-809343f87cf5 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1581e554-e736-4809-9dd2-809343f87cf5 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:35 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-1581e554-e736-4809-9dd2-809343f87cf5 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043426 Apr 13 18:59:35 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 74/216] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:59:35 2023] GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:38 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-293d15b2-a01b-42ec-b522-1d5b48470005 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:38 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-293d15b2-a01b-42ec-b522-1d5b48470005 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-293d15b2-a01b-42ec-b522-1d5b48470005 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-293d15b2-a01b-42ec-b522-1d5b48470005 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-293d15b2-a01b-42ec-b522-1d5b48470005 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-293d15b2-a01b-42ec-b522-1d5b48470005 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-293d15b2-a01b-42ec-b522-1d5b48470005 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-293d15b2-a01b-42ec-b522-1d5b48470005 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:38 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-293d15b2-a01b-42ec-b522-1d5b48470005 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.128063 Apr 13 18:59:38 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 71/217] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 18:59:38 2023] GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583/os-interface => generated 1828 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:59:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "tag": "e45634b1-0f7f-4888-ae83-8567da56407d"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] Creating event network-changed:e45634b1-0f7f-4888-ae83-8567da56407d for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044364 Apr 13 18:59:39 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 73/218] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:39 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3ababd61-9893-49c5-98cd-75b9c8559456 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:39 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-3ababd61-9893-49c5-98cd-75b9c8559456 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3ababd61-9893-49c5-98cd-75b9c8559456 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3ababd61-9893-49c5-98cd-75b9c8559456 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3ababd61-9893-49c5-98cd-75b9c8559456 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3ababd61-9893-49c5-98cd-75b9c8559456 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3ababd61-9893-49c5-98cd-75b9c8559456 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3ababd61-9893-49c5-98cd-75b9c8559456 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:39 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-3ababd61-9893-49c5-98cd-75b9c8559456 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:39 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-3ababd61-9893-49c5-98cd-75b9c8559456 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:39 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-3ababd61-9893-49c5-98cd-75b9c8559456 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:39 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-3ababd61-9893-49c5-98cd-75b9c8559456 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583" status: 200 len: 2822 microversion: 2.42 time: 0.349370 Apr 13 18:59:39 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 75/219] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:59:39 2023] GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583 => generated 2822 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:59:39 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ead4e0e4-6470-4b92-a1f4-13ee69c14f66 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:39 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ead4e0e4-6470-4b92-a1f4-13ee69c14f66 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ead4e0e4-6470-4b92-a1f4-13ee69c14f66 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ead4e0e4-6470-4b92-a1f4-13ee69c14f66 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ead4e0e4-6470-4b92-a1f4-13ee69c14f66 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ead4e0e4-6470-4b92-a1f4-13ee69c14f66 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ead4e0e4-6470-4b92-a1f4-13ee69c14f66 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ead4e0e4-6470-4b92-a1f4-13ee69c14f66 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:39 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ead4e0e4-6470-4b92-a1f4-13ee69c14f66 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.155083 Apr 13 18:59:39 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 72/220] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 18:59:39 2023] GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583/os-interface => generated 1828 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:59:40 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:40 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:40 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 18:59:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583" status: 204 len: 0 microversion: 2.42 time: 0.116740 Apr 13 18:59:40 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 74/221] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 18:59:40 2023] DELETE /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-bb2f633b-518e-47c1-8e2f-68e6b9a71a45 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-bb2f633b-518e-47c1-8e2f-68e6b9a71a45 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bb2f633b-518e-47c1-8e2f-68e6b9a71a45 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bb2f633b-518e-47c1-8e2f-68e6b9a71a45 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bb2f633b-518e-47c1-8e2f-68e6b9a71a45 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bb2f633b-518e-47c1-8e2f-68e6b9a71a45 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bb2f633b-518e-47c1-8e2f-68e6b9a71a45 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bb2f633b-518e-47c1-8e2f-68e6b9a71a45 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-bb2f633b-518e-47c1-8e2f-68e6b9a71a45 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-bb2f633b-518e-47c1-8e2f-68e6b9a71a45 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-bb2f633b-518e-47c1-8e2f-68e6b9a71a45 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:41 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-bb2f633b-518e-47c1-8e2f-68e6b9a71a45 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583" status: 200 len: 2947 microversion: 2.42 time: 0.211949 Apr 13 18:59:41 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 76/222] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 18:59:41 2023] GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583 => generated 2947 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 18:59:41 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-024d4e02-4db5-48a2-ac75-4e9982ddffc2 req-f3d426ea-b746-4661-8512-699c751113f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-unplugged", "status": "completed", "tag": "e45634b1-0f7f-4888-ae83-8567da56407d"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-024d4e02-4db5-48a2-ac75-4e9982ddffc2 req-f3d426ea-b746-4661-8512-699c751113f1 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-024d4e02-4db5-48a2-ac75-4e9982ddffc2 req-f3d426ea-b746-4661-8512-699c751113f1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-024d4e02-4db5-48a2-ac75-4e9982ddffc2 req-f3d426ea-b746-4661-8512-699c751113f1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-024d4e02-4db5-48a2-ac75-4e9982ddffc2 req-f3d426ea-b746-4661-8512-699c751113f1 service nova] Creating event network-vif-unplugged:e45634b1-0f7f-4888-ae83-8567da56407d for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-024d4e02-4db5-48a2-ac75-4e9982ddffc2 req-f3d426ea-b746-4661-8512-699c751113f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034173 Apr 13 18:59:41 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 73/223] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:59:41 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-7113a723-567c-4ad5-9104-6d921ccee072 req-cd557565-c19f-4e40-a116-8a6a515ec022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-unplugged", "status": "completed", "tag": "624b1877-60ef-44ae-b9fa-c07cacb7fb72"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7113a723-567c-4ad5-9104-6d921ccee072 req-cd557565-c19f-4e40-a116-8a6a515ec022 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7113a723-567c-4ad5-9104-6d921ccee072 req-cd557565-c19f-4e40-a116-8a6a515ec022 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7113a723-567c-4ad5-9104-6d921ccee072 req-cd557565-c19f-4e40-a116-8a6a515ec022 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:41 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-7113a723-567c-4ad5-9104-6d921ccee072 req-cd557565-c19f-4e40-a116-8a6a515ec022 service nova] Creating event network-vif-unplugged:624b1877-60ef-44ae-b9fa-c07cacb7fb72 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:41 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-7113a723-567c-4ad5-9104-6d921ccee072 req-cd557565-c19f-4e40-a116-8a6a515ec022 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036664 Apr 13 18:59:41 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 75/224] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-be2a240f-caf3-4e36-a581-ba90dcaaaa85 req-ce59baf0-8174-4b69-9ce8-b440e9a74c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-unplugged", "status": "completed", "tag": "0411f083-60b0-41d4-af75-a509ace59ad5"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-be2a240f-caf3-4e36-a581-ba90dcaaaa85 req-ce59baf0-8174-4b69-9ce8-b440e9a74c78 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-be2a240f-caf3-4e36-a581-ba90dcaaaa85 req-ce59baf0-8174-4b69-9ce8-b440e9a74c78 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-be2a240f-caf3-4e36-a581-ba90dcaaaa85 req-ce59baf0-8174-4b69-9ce8-b440e9a74c78 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:41 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-be2a240f-caf3-4e36-a581-ba90dcaaaa85 req-ce59baf0-8174-4b69-9ce8-b440e9a74c78 service nova] Creating event network-vif-unplugged:0411f083-60b0-41d4-af75-a509ace59ad5 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:41 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-be2a240f-caf3-4e36-a581-ba90dcaaaa85 req-ce59baf0-8174-4b69-9ce8-b440e9a74c78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049353 Apr 13 18:59:41 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 77/225] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:43 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "e45634b1-0f7f-4888-ae83-8567da56407d"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-unplugged", "status": "completed", "tag": "7512b86a-c124-4ae8-907e-8490d9444e87"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "7512b86a-c124-4ae8-907e-8490d9444e87"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:43 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Creating event network-vif-plugged:e45634b1-0f7f-4888-ae83-8567da56407d for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:43 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Creating event network-vif-unplugged:7512b86a-c124-4ae8-907e-8490d9444e87 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:43 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Creating event network-vif-plugged:7512b86a-c124-4ae8-907e-8490d9444e87 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:43 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.033944 Apr 13 18:59:43 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 74/226] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:43 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:43 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "624b1877-60ef-44ae-b9fa-c07cacb7fb72"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-unplugged", "status": "completed", "tag": "278cf193-9dcb-4703-b7d3-d3568a793952"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "278cf193-9dcb-4703-b7d3-d3568a793952"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-unplugged", "status": "completed", "tag": "50b51917-5a26-4a85-878a-7d21023a7fb1"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "50b51917-5a26-4a85-878a-7d21023a7fb1"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Creating event network-vif-plugged:624b1877-60ef-44ae-b9fa-c07cacb7fb72 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Creating event network-vif-unplugged:278cf193-9dcb-4703-b7d3-d3568a793952 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Creating event network-vif-plugged:278cf193-9dcb-4703-b7d3-d3568a793952 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Creating event network-vif-unplugged:50b51917-5a26-4a85-878a-7d21023a7fb1 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Creating event network-vif-plugged:50b51917-5a26-4a85-878a-7d21023a7fb1 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.053347 Apr 13 18:59:43 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 76/227] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:43 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:43 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "0411f083-60b0-41d4-af75-a509ace59ad5"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-unplugged", "status": "completed", "tag": "8f025dce-fc38-4414-8e60-c924fd38d5dd"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-plugged", "status": "completed", "tag": "8f025dce-fc38-4414-8e60-c924fd38d5dd"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Creating event network-vif-plugged:0411f083-60b0-41d4-af75-a509ace59ad5 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Creating event network-vif-unplugged:8f025dce-fc38-4414-8e60-c924fd38d5dd for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Creating event network-vif-plugged:8f025dce-fc38-4414-8e60-c924fd38d5dd for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.038330 Apr 13 18:59:43 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 78/228] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:43 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:45 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-ebf98629-53d6-4726-896c-f1dc87f5d8cb req-57bf4d69-47c0-4b79-b3db-8c2087aa4b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-deleted", "tag": "8f025dce-fc38-4414-8e60-c924fd38d5dd"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:45 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ebf98629-53d6-4726-896c-f1dc87f5d8cb req-57bf4d69-47c0-4b79-b3db-8c2087aa4b5e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:45 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ebf98629-53d6-4726-896c-f1dc87f5d8cb req-57bf4d69-47c0-4b79-b3db-8c2087aa4b5e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:45 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ebf98629-53d6-4726-896c-f1dc87f5d8cb req-57bf4d69-47c0-4b79-b3db-8c2087aa4b5e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:45 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-ebf98629-53d6-4726-896c-f1dc87f5d8cb req-57bf4d69-47c0-4b79-b3db-8c2087aa4b5e service nova] Creating event network-vif-deleted:8f025dce-fc38-4414-8e60-c924fd38d5dd for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:45 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-ebf98629-53d6-4726-896c-f1dc87f5d8cb req-57bf4d69-47c0-4b79-b3db-8c2087aa4b5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034101 Apr 13 18:59:45 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 75/229] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 18:59:47 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-deleted", "tag": "e45634b1-0f7f-4888-ae83-8567da56407d"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-deleted", "tag": "50b51917-5a26-4a85-878a-7d21023a7fb1"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-deleted", "tag": "278cf193-9dcb-4703-b7d3-d3568a793952"}, {"server_uuid": "c655dda4-2db1-4f7c-8591-bb0512122583", "name": "network-vif-deleted", "tag": "0411f083-60b0-41d4-af75-a509ace59ad5"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] Creating event network-vif-deleted:e45634b1-0f7f-4888-ae83-8567da56407d for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] Creating event network-vif-deleted:50b51917-5a26-4a85-878a-7d21023a7fb1 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] Creating event network-vif-deleted:278cf193-9dcb-4703-b7d3-d3568a793952 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] Creating event network-vif-deleted:0411f083-60b0-41d4-af75-a509ace59ad5 for instance c655dda4-2db1-4f7c-8591-bb0512122583 on user Apr 13 18:59:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.033324 Apr 13 18:59:47 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 77/230] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:47 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 18:59:56 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=13 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:56 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=33 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:56 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-89ab94c8-fd16-4414-b9e3-9a75d47930ef tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:56 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-89ab94c8-fd16-4414-b9e3-9a75d47930ef tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-89ab94c8-fd16-4414-b9e3-9a75d47930ef tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-89ab94c8-fd16-4414-b9e3-9a75d47930ef tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-89ab94c8-fd16-4414-b9e3-9a75d47930ef tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-89ab94c8-fd16-4414-b9e3-9a75d47930ef tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-89ab94c8-fd16-4414-b9e3-9a75d47930ef tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-89ab94c8-fd16-4414-b9e3-9a75d47930ef tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-89ab94c8-fd16-4414-b9e3-9a75d47930ef tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050915 Apr 13 18:59:56 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 79/231] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 18:59:56 2023] GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=20 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=44 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2091050597", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "99569b6e-2d6c-4e03-9971-462e962f316f"}]}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] validate_networks() for [('99569b6e-2d6c-4e03-9971-462e962f316f', None, None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Getting quotas for project 0d708f05aa7c454bbf94931b6b5593bf. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Getting quotas for user 3e1ffe2f879f4c049b6c28d3a9623d14 and project 0d708f05aa7c454bbf94931b6b5593bf. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 18:59:56 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 18:59:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.605509 Apr 13 18:59:56 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 76/232] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 18:59:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 18:59:56 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-76c6443d-bccb-443b-9821-215e49b5e955 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 18:59:56 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-76c6443d-bccb-443b-9821-215e49b5e955 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 18:59:56 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 18:59:56 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-76c6443d-bccb-443b-9821-215e49b5e955 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1ffe2f879f4c049b6c28d3a9623d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d708f05aa7c454bbf94931b6b5593bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 18:59:56 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-76c6443d-bccb-443b-9821-215e49b5e955 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888" status: 200 len: 1212 microversion: 2.1 time: 0.084431 Apr 13 18:59:56 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 78/233] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 18:59:56 2023] GET /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 18:59:59 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81690e5b-0bcc-4e7c-87b6-e51a30571888", "tag": "97015895-15bd-401e-aa52-776f82605bc4"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 18:59:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 18:59:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 18:59:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 18:59:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] Creating event network-changed:97015895-15bd-401e-aa52-776f82605bc4 for instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 on user Apr 13 18:59:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028719 Apr 13 18:59:59 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 80/234] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 18:59:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:01 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-791081b3-715a-43c8-b49f-6c8eb0800525 req-d49f5c20-e36c-460e-b916-d673979fc2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81690e5b-0bcc-4e7c-87b6-e51a30571888", "name": "network-vif-plugged", "status": "completed", "tag": "97015895-15bd-401e-aa52-776f82605bc4"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-791081b3-715a-43c8-b49f-6c8eb0800525 req-d49f5c20-e36c-460e-b916-d673979fc2d3 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-791081b3-715a-43c8-b49f-6c8eb0800525 req-d49f5c20-e36c-460e-b916-d673979fc2d3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-791081b3-715a-43c8-b49f-6c8eb0800525 req-d49f5c20-e36c-460e-b916-d673979fc2d3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:01 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-791081b3-715a-43c8-b49f-6c8eb0800525 req-d49f5c20-e36c-460e-b916-d673979fc2d3 service nova] Creating event network-vif-plugged:97015895-15bd-401e-aa52-776f82605bc4 for instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 on user Apr 13 19:00:01 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-791081b3-715a-43c8-b49f-6c8eb0800525 req-d49f5c20-e36c-460e-b916-d673979fc2d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046371 Apr 13 19:00:01 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 77/235] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f7dfd206-7d94-45ce-8b69-3b4576bd46cf tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:02 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f7dfd206-7d94-45ce-8b69-3b4576bd46cf tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:02 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:00:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f7dfd206-7d94-45ce-8b69-3b4576bd46cf tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f7dfd206-7d94-45ce-8b69-3b4576bd46cf tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f7dfd206-7d94-45ce-8b69-3b4576bd46cf tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f7dfd206-7d94-45ce-8b69-3b4576bd46cf tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f7dfd206-7d94-45ce-8b69-3b4576bd46cf tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f7dfd206-7d94-45ce-8b69-3b4576bd46cf tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-f7dfd206-7d94-45ce-8b69-3b4576bd46cf tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] HTTP exception thrown: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f7dfd206-7d94-45ce-8b69-3b4576bd46cf tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Request method failure captured: Apr 13 19:00:02 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0 HTTP/1.1 Apr 13 19:00:02 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:00:02 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:00:02 user devstack@n-api.service[61588]: Connection: close Apr 13 19:00:02 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:00:02 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:00:02 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:00:02 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:00:02 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBgbYcPOJqDLPKSnayhsvHEyaH6MJI6nsrW7eBRXepGuWuRO0zwTS26birG9w_3nvhbKlxGdcRkkAh6eWFLl5CEKHeUSDH9a4L_WafVUNWnemqEkRpERNGUmiHX4RS-iI82k9qPVKp95f9TMpSojQhr18q0GqVyMcf8YZymXpE9e8U Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Project-Id: a103d122466143fa96dabc7aec4c2b80 Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-655554039 Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a103d122466143fa96dabc7aec4c2b80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a103d122466143fa96dabc7aec4c2b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a103d122466143fa96dabc7aec4c2b80"}]}] Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-655554039 Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Tenant-Id: a103d122466143fa96dabc7aec4c2b80 Apr 13 19:00:02 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-655554039 Apr 13 19:00:02 user devstack@n-api.service[61588]: X-User: tempest-AttachSCSIVolumeTestJSON-655554039-project-member Apr 13 19:00:02 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:00:02 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:00:02 user devstack@n-api.service[61588]: X-User-Id: bfd7cd2f777f4101bc727349911ae5c3 Apr 13 19:00:02 user devstack@n-api.service[61588]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-655554039-project-member Apr 13 19:00:02 user devstack@n-api.service[61588]: method: > Apr 13 19:00:02 user devstack@n-api.service[61588]: exception: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:02 user devstack@n-api.service[61588]: action_args: {'id': '0ed13b57-30a9-44c2-a18d-f936d33209b0'} Apr 13 19:00:02 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f7dfd206-7d94-45ce-8b69-3b4576bd46cf tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Returning 404 to user: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:00:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-f7dfd206-7d94-45ce-8b69-3b4576bd46cf tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0" status: 404 len: 111 microversion: 2.1 time: 0.035913 Apr 13 19:00:02 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 79/236] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:00:02 2023] GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:00:02 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ffcc6ecf-3589-4ffd-83c5-c68a36adee85 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '.version_select at 0x7efe3847a710>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:02 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-ffcc6ecf-3589-4ffd-83c5-c68a36adee85 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173318920" status: 202 len: 0 microversion: 2.1 time: 0.022707 Apr 13 19:00:02 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 81/237] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 19:00:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173318920 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:00:03 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-ab104923-5ec7-46a8-a0ce-d68702737921 req-d0faf8ed-33b3-4dd1-9d40-dc6041167e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81690e5b-0bcc-4e7c-87b6-e51a30571888", "name": "network-vif-plugged", "status": "completed", "tag": "97015895-15bd-401e-aa52-776f82605bc4"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ab104923-5ec7-46a8-a0ce-d68702737921 req-d0faf8ed-33b3-4dd1-9d40-dc6041167e13 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ab104923-5ec7-46a8-a0ce-d68702737921 req-d0faf8ed-33b3-4dd1-9d40-dc6041167e13 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ab104923-5ec7-46a8-a0ce-d68702737921 req-d0faf8ed-33b3-4dd1-9d40-dc6041167e13 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:03 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-ab104923-5ec7-46a8-a0ce-d68702737921 req-d0faf8ed-33b3-4dd1-9d40-dc6041167e13 service nova] Creating event network-vif-plugged:97015895-15bd-401e-aa52-776f82605bc4 for instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 on user Apr 13 19:00:03 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-ab104923-5ec7-46a8-a0ce-d68702737921 req-d0faf8ed-33b3-4dd1-9d40-dc6041167e13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052094 Apr 13 19:00:03 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 78/238] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-43a5c6f6-ed79-49b2-8024-b300a08d9541 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:05 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-43a5c6f6-ed79-49b2-8024-b300a08d9541 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-43a5c6f6-ed79-49b2-8024-b300a08d9541 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-43a5c6f6-ed79-49b2-8024-b300a08d9541 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-43a5c6f6-ed79-49b2-8024-b300a08d9541 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-43a5c6f6-ed79-49b2-8024-b300a08d9541 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-43a5c6f6-ed79-49b2-8024-b300a08d9541 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-43a5c6f6-ed79-49b2-8024-b300a08d9541 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-43a5c6f6-ed79-49b2-8024-b300a08d9541 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] HTTP exception thrown: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-43a5c6f6-ed79-49b2-8024-b300a08d9541 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Request method failure captured: Apr 13 19:00:05 user devstack@n-api.service[61588]: request: DELETE /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0 HTTP/1.1 Apr 13 19:00:05 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:00:05 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:00:05 user devstack@n-api.service[61588]: Connection: close Apr 13 19:00:05 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:00:05 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:00:05 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:00:05 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:00:05 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBgbYcPOJqDLPKSnayhsvHEyaH6MJI6nsrW7eBRXepGuWuRO0zwTS26birG9w_3nvhbKlxGdcRkkAh6eWFLl5CEKHeUSDH9a4L_WafVUNWnemqEkRpERNGUmiHX4RS-iI82k9qPVKp95f9TMpSojQhr18q0GqVyMcf8YZymXpE9e8U Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Project-Id: a103d122466143fa96dabc7aec4c2b80 Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-655554039 Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a103d122466143fa96dabc7aec4c2b80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a103d122466143fa96dabc7aec4c2b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a103d122466143fa96dabc7aec4c2b80"}]}] Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-655554039 Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Tenant-Id: a103d122466143fa96dabc7aec4c2b80 Apr 13 19:00:05 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-655554039 Apr 13 19:00:05 user devstack@n-api.service[61588]: X-User: tempest-AttachSCSIVolumeTestJSON-655554039-project-member Apr 13 19:00:05 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:00:05 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:00:05 user devstack@n-api.service[61588]: X-User-Id: bfd7cd2f777f4101bc727349911ae5c3 Apr 13 19:00:05 user devstack@n-api.service[61588]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-655554039-project-member Apr 13 19:00:05 user devstack@n-api.service[61588]: method: > Apr 13 19:00:05 user devstack@n-api.service[61588]: exception: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:05 user devstack@n-api.service[61588]: action_args: {'id': '0ed13b57-30a9-44c2-a18d-f936d33209b0'} Apr 13 19:00:05 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:05 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-43a5c6f6-ed79-49b2-8024-b300a08d9541 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Returning 404 to user: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:00:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-43a5c6f6-ed79-49b2-8024-b300a08d9541 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0" status: 404 len: 111 microversion: 2.1 time: 0.035461 Apr 13 19:00:05 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 80/239] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:00:05 2023] DELETE /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:00:05 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ff9e1256-bf5c-4dd9-b40b-3e6922def1c7 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:05 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-ff9e1256-bf5c-4dd9-b40b-3e6922def1c7 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ff9e1256-bf5c-4dd9-b40b-3e6922def1c7 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ff9e1256-bf5c-4dd9-b40b-3e6922def1c7 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ff9e1256-bf5c-4dd9-b40b-3e6922def1c7 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ff9e1256-bf5c-4dd9-b40b-3e6922def1c7 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ff9e1256-bf5c-4dd9-b40b-3e6922def1c7 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ff9e1256-bf5c-4dd9-b40b-3e6922def1c7 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:05 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-ff9e1256-bf5c-4dd9-b40b-3e6922def1c7 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] HTTP exception thrown: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:05 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ff9e1256-bf5c-4dd9-b40b-3e6922def1c7 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Request method failure captured: Apr 13 19:00:05 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0 HTTP/1.1 Apr 13 19:00:05 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:00:05 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:00:05 user devstack@n-api.service[61587]: Connection: close Apr 13 19:00:05 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:00:05 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:00:05 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:00:05 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:00:05 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBgbYcPOJqDLPKSnayhsvHEyaH6MJI6nsrW7eBRXepGuWuRO0zwTS26birG9w_3nvhbKlxGdcRkkAh6eWFLl5CEKHeUSDH9a4L_WafVUNWnemqEkRpERNGUmiHX4RS-iI82k9qPVKp95f9TMpSojQhr18q0GqVyMcf8YZymXpE9e8U Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Project-Id: a103d122466143fa96dabc7aec4c2b80 Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-655554039 Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a103d122466143fa96dabc7aec4c2b80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a103d122466143fa96dabc7aec4c2b80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a103d122466143fa96dabc7aec4c2b80"}]}] Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-655554039 Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Tenant-Id: a103d122466143fa96dabc7aec4c2b80 Apr 13 19:00:05 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-655554039 Apr 13 19:00:05 user devstack@n-api.service[61587]: X-User: tempest-AttachSCSIVolumeTestJSON-655554039-project-member Apr 13 19:00:05 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:00:05 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:00:05 user devstack@n-api.service[61587]: X-User-Id: bfd7cd2f777f4101bc727349911ae5c3 Apr 13 19:00:05 user devstack@n-api.service[61587]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-655554039-project-member Apr 13 19:00:05 user devstack@n-api.service[61587]: method: > Apr 13 19:00:05 user devstack@n-api.service[61587]: exception: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:05 user devstack@n-api.service[61587]: action_args: {'id': '0ed13b57-30a9-44c2-a18d-f936d33209b0'} Apr 13 19:00:05 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. Apr 13 19:00:05 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:00:05 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ff9e1256-bf5c-4dd9-b40b-3e6922def1c7 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Returning 404 to user: Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:00:05 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-ff9e1256-bf5c-4dd9-b40b-3e6922def1c7 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0" status: 404 len: 111 microversion: 2.1 time: 0.032727 Apr 13 19:00:05 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 82/240] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:00:05 2023] GET /compute/v2.1/servers/0ed13b57-30a9-44c2-a18d-f936d33209b0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:24 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Going to try to terminate instance {{(pid=61589) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:00:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" status: 204 len: 0 microversion: 2.1 time: 0.172776 Apr 13 19:00:24 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 79/241] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:00:24 2023] DELETE /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:00:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4f37b84f-3226-4b53-9b56-71e83fe389a2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:24 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-4f37b84f-3226-4b53-9b56-71e83fe389a2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:00:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=7 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:00:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:00:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4f37b84f-3226-4b53-9b56-71e83fe389a2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4f37b84f-3226-4b53-9b56-71e83fe389a2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4f37b84f-3226-4b53-9b56-71e83fe389a2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4f37b84f-3226-4b53-9b56-71e83fe389a2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4f37b84f-3226-4b53-9b56-71e83fe389a2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4f37b84f-3226-4b53-9b56-71e83fe389a2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:24 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-4f37b84f-3226-4b53-9b56-71e83fe389a2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7f76b4b7fb4651b3bce0e72f8a4de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1308cc4c5734de9a9fd83688c8da796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:00:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-4f37b84f-3226-4b53-9b56-71e83fe389a2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" status: 200 len: 1499 microversion: 2.1 time: 0.213515 Apr 13 19:00:24 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 81/242] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:00:24 2023] GET /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb => generated 1499 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:00:24 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:00:24 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=10 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:00:24 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-e824de80-7ffb-47e0-a1bf-70d2c1ec6639 req-066bf4bb-a29b-42e2-8b8a-9e12cdd95908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb", "name": "network-vif-unplugged", "status": "completed", "tag": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e824de80-7ffb-47e0-a1bf-70d2c1ec6639 req-066bf4bb-a29b-42e2-8b8a-9e12cdd95908 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e824de80-7ffb-47e0-a1bf-70d2c1ec6639 req-066bf4bb-a29b-42e2-8b8a-9e12cdd95908 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e824de80-7ffb-47e0-a1bf-70d2c1ec6639 req-066bf4bb-a29b-42e2-8b8a-9e12cdd95908 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:24 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-e824de80-7ffb-47e0-a1bf-70d2c1ec6639 req-066bf4bb-a29b-42e2-8b8a-9e12cdd95908 service nova] Creating event network-vif-unplugged:6d3713a2-ef39-4f8b-964a-e4bcd4082bea for instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb on user Apr 13 19:00:24 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-e824de80-7ffb-47e0-a1bf-70d2c1ec6639 req-066bf4bb-a29b-42e2-8b8a-9e12cdd95908 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043024 Apr 13 19:00:24 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 83/243] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-26f1ed9d-cd8f-4a0f-a000-0de2caa9d898 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:25 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-26f1ed9d-cd8f-4a0f-a000-0de2caa9d898 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-26f1ed9d-cd8f-4a0f-a000-0de2caa9d898 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-26f1ed9d-cd8f-4a0f-a000-0de2caa9d898 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-26f1ed9d-cd8f-4a0f-a000-0de2caa9d898 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-26f1ed9d-cd8f-4a0f-a000-0de2caa9d898 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-26f1ed9d-cd8f-4a0f-a000-0de2caa9d898 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-26f1ed9d-cd8f-4a0f-a000-0de2caa9d898 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-26f1ed9d-cd8f-4a0f-a000-0de2caa9d898 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046427 Apr 13 19:00:25 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 80/244] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:00:25 2023] GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:00:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:25 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:25 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:00:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453" status: 204 len: 0 microversion: 2.1 time: 0.115610 Apr 13 19:00:25 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 82/245] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:00:25 2023] DELETE /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:00:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-d20dbb03-e3f4-4427-b33d-489fb14cb9fb tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:25 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-d20dbb03-e3f4-4427-b33d-489fb14cb9fb tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d20dbb03-e3f4-4427-b33d-489fb14cb9fb tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d20dbb03-e3f4-4427-b33d-489fb14cb9fb tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d20dbb03-e3f4-4427-b33d-489fb14cb9fb tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d20dbb03-e3f4-4427-b33d-489fb14cb9fb tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d20dbb03-e3f4-4427-b33d-489fb14cb9fb tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d20dbb03-e3f4-4427-b33d-489fb14cb9fb tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:26 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-d20dbb03-e3f4-4427-b33d-489fb14cb9fb tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff89f9a33e348e69d8a7e986100d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc420cebeb8945cea96fe22173ad2b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:00:26 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-d20dbb03-e3f4-4427-b33d-489fb14cb9fb tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453" status: 200 len: 1650 microversion: 2.1 time: 0.162491 Apr 13 19:00:26 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 84/246] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:00:25 2023] GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453 => generated 1650 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:00:26 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-6d4d8fc2-7892-46ba-b77e-4b21828750be req-f4173c4d-5a4d-4e56-b7e3-c490d041b8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570101b9-9c60-4c05-94ab-437a8a07d453", "name": "network-vif-unplugged", "status": "completed", "tag": "3e432daf-10a6-4797-b1f8-ad67a2b8417f"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:26 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6d4d8fc2-7892-46ba-b77e-4b21828750be req-f4173c4d-5a4d-4e56-b7e3-c490d041b8f4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:26 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6d4d8fc2-7892-46ba-b77e-4b21828750be req-f4173c4d-5a4d-4e56-b7e3-c490d041b8f4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:26 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6d4d8fc2-7892-46ba-b77e-4b21828750be req-f4173c4d-5a4d-4e56-b7e3-c490d041b8f4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:26 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-6d4d8fc2-7892-46ba-b77e-4b21828750be req-f4173c4d-5a4d-4e56-b7e3-c490d041b8f4 service nova] Creating event network-vif-unplugged:3e432daf-10a6-4797-b1f8-ad67a2b8417f for instance 570101b9-9c60-4c05-94ab-437a8a07d453 on user Apr 13 19:00:26 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-6d4d8fc2-7892-46ba-b77e-4b21828750be req-f4173c4d-5a4d-4e56-b7e3-c490d041b8f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028599 Apr 13 19:00:26 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 81/247] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:26 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb", "name": "network-vif-plugged", "status": "completed", "tag": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea"}, {"server_uuid": "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb", "name": "network-vif-deleted", "tag": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:26 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] Creating event network-vif-plugged:6d3713a2-ef39-4f8b-964a-e4bcd4082bea for instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb on user Apr 13 19:00:26 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] Creating event network-vif-deleted:6d3713a2-ef39-4f8b-964a-e4bcd4082bea for instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb on user Apr 13 19:00:26 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034053 Apr 13 19:00:26 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 83/248] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:28 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Going to try to start instance {{(pid=61587) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 19:00:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/action" status: 202 len: 0 microversion: 2.1 time: 0.112607 Apr 13 19:00:28 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 85/249] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:00:28 2023] POST /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:00:28 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-0e353648-9aab-45a2-bce5-bd984ce170c1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:28 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-0e353648-9aab-45a2-bce5-bd984ce170c1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0e353648-9aab-45a2-bce5-bd984ce170c1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0e353648-9aab-45a2-bce5-bd984ce170c1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0e353648-9aab-45a2-bce5-bd984ce170c1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0e353648-9aab-45a2-bce5-bd984ce170c1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0e353648-9aab-45a2-bce5-bd984ce170c1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0e353648-9aab-45a2-bce5-bd984ce170c1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-36b2c557-5b46-4f3d-a465-25c233410a4b req-1b34c4d3-46cc-40b2-9c92-49a47282fbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570101b9-9c60-4c05-94ab-437a8a07d453", "name": "network-vif-plugged", "status": "completed", "tag": "3e432daf-10a6-4797-b1f8-ad67a2b8417f"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-36b2c557-5b46-4f3d-a465-25c233410a4b req-1b34c4d3-46cc-40b2-9c92-49a47282fbaf service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-36b2c557-5b46-4f3d-a465-25c233410a4b req-1b34c4d3-46cc-40b2-9c92-49a47282fbaf service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-36b2c557-5b46-4f3d-a465-25c233410a4b req-1b34c4d3-46cc-40b2-9c92-49a47282fbaf service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-36b2c557-5b46-4f3d-a465-25c233410a4b req-1b34c4d3-46cc-40b2-9c92-49a47282fbaf service nova] Creating event network-vif-plugged:3e432daf-10a6-4797-b1f8-ad67a2b8417f for instance 570101b9-9c60-4c05-94ab-437a8a07d453 on user Apr 13 19:00:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-36b2c557-5b46-4f3d-a465-25c233410a4b req-1b34c4d3-46cc-40b2-9c92-49a47282fbaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031880 Apr 13 19:00:28 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 84/250] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:28 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-0e353648-9aab-45a2-bce5-bd984ce170c1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:00:28 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-0e353648-9aab-45a2-bce5-bd984ce170c1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 200 len: 1696 microversion: 2.1 time: 0.159921 Apr 13 19:00:28 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 82/251] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:00:28 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:00:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-4a533b2f-772c-4ecc-8b32-02d9fa52e9d6 req-34e44a8b-0ad0-4455-95e9-a5acf53cbed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570101b9-9c60-4c05-94ab-437a8a07d453", "name": "network-vif-deleted", "tag": "3e432daf-10a6-4797-b1f8-ad67a2b8417f"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4a533b2f-772c-4ecc-8b32-02d9fa52e9d6 req-34e44a8b-0ad0-4455-95e9-a5acf53cbed3 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4a533b2f-772c-4ecc-8b32-02d9fa52e9d6 req-34e44a8b-0ad0-4455-95e9-a5acf53cbed3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4a533b2f-772c-4ecc-8b32-02d9fa52e9d6 req-34e44a8b-0ad0-4455-95e9-a5acf53cbed3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-4a533b2f-772c-4ecc-8b32-02d9fa52e9d6 req-34e44a8b-0ad0-4455-95e9-a5acf53cbed3 service nova] Creating event network-vif-deleted:3e432daf-10a6-4797-b1f8-ad67a2b8417f for instance 570101b9-9c60-4c05-94ab-437a8a07d453 on user Apr 13 19:00:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-4a533b2f-772c-4ecc-8b32-02d9fa52e9d6 req-34e44a8b-0ad0-4455-95e9-a5acf53cbed3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032746 Apr 13 19:00:28 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 86/252] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:31 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-51f9c059-ba4d-4343-a079-1c9f9ff20317 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:31 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-51f9c059-ba4d-4343-a079-1c9f9ff20317 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-51f9c059-ba4d-4343-a079-1c9f9ff20317 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-51f9c059-ba4d-4343-a079-1c9f9ff20317 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-51f9c059-ba4d-4343-a079-1c9f9ff20317 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-51f9c059-ba4d-4343-a079-1c9f9ff20317 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-51f9c059-ba4d-4343-a079-1c9f9ff20317 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-51f9c059-ba4d-4343-a079-1c9f9ff20317 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-51f9c059-ba4d-4343-a079-1c9f9ff20317 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] HTTP exception thrown: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:31 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-51f9c059-ba4d-4343-a079-1c9f9ff20317 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Request method failure captured: Apr 13 19:00:31 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583 HTTP/1.1 Apr 13 19:00:31 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:00:31 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:00:31 user devstack@n-api.service[61588]: Connection: close Apr 13 19:00:31 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:00:31 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:00:31 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:00:31 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:00:31 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBpZwx_4Q1LKbfXTpJnfsGqQ3IR9M4KcvHrqHSqafblHEf38Ruw_N-9YlV47HoIImU9n4hzibQdInN6U6ToFz4FV0plIiRLRNoIHpLWCGJzgI0SC2Emi4chn7aFEbxaLNr-WjwUXSQi7BnjYOrDn2QsLUCBFHMKWCfoLYiiGneAgO8 Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Project-Id: 0e7c45edf2a84f86b4c91c12edb8c66a Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-573903665 Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e7c45edf2a84f86b4c91c12edb8c66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0e7c45edf2a84f86b4c91c12edb8c66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e7c45edf2a84f86b4c91c12edb8c66a"}]}] Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Tenant: tempest-TaggedBootDevicesTest_v242-573903665 Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Tenant-Id: 0e7c45edf2a84f86b4c91c12edb8c66a Apr 13 19:00:31 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-573903665 Apr 13 19:00:31 user devstack@n-api.service[61588]: X-User: tempest-TaggedBootDevicesTest_v242-573903665-project-member Apr 13 19:00:31 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:00:31 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:00:31 user devstack@n-api.service[61588]: X-User-Id: f63a7e8a5a374e66b26f2309874c5adb Apr 13 19:00:31 user devstack@n-api.service[61588]: X-User-Name: tempest-TaggedBootDevicesTest_v242-573903665-project-member Apr 13 19:00:31 user devstack@n-api.service[61588]: method: > Apr 13 19:00:31 user devstack@n-api.service[61588]: exception: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:31 user devstack@n-api.service[61588]: action_args: {'id': 'c655dda4-2db1-4f7c-8591-bb0512122583'} Apr 13 19:00:31 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:31 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-51f9c059-ba4d-4343-a079-1c9f9ff20317 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Returning 404 to user: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:00:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-51f9c059-ba4d-4343-a079-1c9f9ff20317 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583" status: 404 len: 111 microversion: 2.42 time: 0.070270 Apr 13 19:00:31 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 85/253] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:00:31 2023] GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:00:31 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d914caa2-114b-425e-b35f-3370bf84f107 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Calling method '.version_select at 0x7efe38140670>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:31 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d914caa2-114b-425e-b35f-3370bf84f107 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123184713" status: 204 len: 0 microversion: 2.42 time: 0.038864 Apr 13 19:00:31 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 83/254] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 19:00:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123184713 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 19:00:33 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-0d051b9a-e81b-475f-85c1-dcfbac7965dd req-229e544e-f8a3-40e8-b70f-d7d7d82bc425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-plugged", "status": "completed", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-0d051b9a-e81b-475f-85c1-dcfbac7965dd req-229e544e-f8a3-40e8-b70f-d7d7d82bc425 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-0d051b9a-e81b-475f-85c1-dcfbac7965dd req-229e544e-f8a3-40e8-b70f-d7d7d82bc425 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-0d051b9a-e81b-475f-85c1-dcfbac7965dd req-229e544e-f8a3-40e8-b70f-d7d7d82bc425 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-0d051b9a-e81b-475f-85c1-dcfbac7965dd req-229e544e-f8a3-40e8-b70f-d7d7d82bc425 service nova] Creating event network-vif-plugged:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 19:00:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-0d051b9a-e81b-475f-85c1-dcfbac7965dd req-229e544e-f8a3-40e8-b70f-d7d7d82bc425 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040051 Apr 13 19:00:33 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 87/255] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:33 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-09de49ad-93b1-4273-866d-028d8eddb984 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20b015e0-df81-41d5-a1fa-0e7666672a88"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:33 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-09de49ad-93b1-4273-866d-028d8eddb984 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-09de49ad-93b1-4273-866d-028d8eddb984 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-09de49ad-93b1-4273-866d-028d8eddb984 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-09de49ad-93b1-4273-866d-028d8eddb984 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-09de49ad-93b1-4273-866d-028d8eddb984 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-09de49ad-93b1-4273-866d-028d8eddb984 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-09de49ad-93b1-4273-866d-028d8eddb984 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:33 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-814aa256-e813-4b89-9e44-9c492fe48ab0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:33 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-814aa256-e813-4b89-9e44-9c492fe48ab0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-814aa256-e813-4b89-9e44-9c492fe48ab0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-814aa256-e813-4b89-9e44-9c492fe48ab0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-814aa256-e813-4b89-9e44-9c492fe48ab0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-814aa256-e813-4b89-9e44-9c492fe48ab0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-814aa256-e813-4b89-9e44-9c492fe48ab0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-814aa256-e813-4b89-9e44-9c492fe48ab0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:33 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-814aa256-e813-4b89-9e44-9c492fe48ab0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:00:33 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-814aa256-e813-4b89-9e44-9c492fe48ab0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1654 microversion: 2.1 time: 0.292322 Apr 13 19:00:33 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 84/256] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:00:33 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1654 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:00:33 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:33 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-09de49ad-93b1-4273-866d-028d8eddb984 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.392772 Apr 13 19:00:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 86/257] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 19:00:33 2023] POST /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/os-volume_attachments => generated 188 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 19:00:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:34 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:34 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61589) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 19:00:34 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.442779 Apr 13 19:00:34 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 88/258] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:00:33 2023] POST /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/action" status: 202 len: 0 microversion: 2.20 time: 0.250196 Apr 13 19:00:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 85/259] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 19:00:34 2023] POST /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:00:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-acbb463c-d8c7-431f-b1d3-22d560ec538c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:34 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-acbb463c-d8c7-431f-b1d3-22d560ec538c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-acbb463c-d8c7-431f-b1d3-22d560ec538c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-acbb463c-d8c7-431f-b1d3-22d560ec538c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-acbb463c-d8c7-431f-b1d3-22d560ec538c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-acbb463c-d8c7-431f-b1d3-22d560ec538c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-acbb463c-d8c7-431f-b1d3-22d560ec538c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-acbb463c-d8c7-431f-b1d3-22d560ec538c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:34 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-acbb463c-d8c7-431f-b1d3-22d560ec538c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:00:34 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-acbb463c-d8c7-431f-b1d3-22d560ec538c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:00:34 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-acbb463c-d8c7-431f-b1d3-22d560ec538c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:00:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-acbb463c-d8c7-431f-b1d3-22d560ec538c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f" status: 200 len: 1738 microversion: 2.20 time: 0.258281 Apr 13 19:00:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 87/260] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:00:34 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:00:35 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-e4ad0287-8a94-4ac0-ab54-2a5dd87357c0 req-880dcd14-1203-4083-a4cb-1d84e3ebb1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-plugged", "status": "completed", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e4ad0287-8a94-4ac0-ab54-2a5dd87357c0 req-880dcd14-1203-4083-a4cb-1d84e3ebb1c6 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e4ad0287-8a94-4ac0-ab54-2a5dd87357c0 req-880dcd14-1203-4083-a4cb-1d84e3ebb1c6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e4ad0287-8a94-4ac0-ab54-2a5dd87357c0 req-880dcd14-1203-4083-a4cb-1d84e3ebb1c6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:35 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-e4ad0287-8a94-4ac0-ab54-2a5dd87357c0 req-880dcd14-1203-4083-a4cb-1d84e3ebb1c6 service nova] Creating event network-vif-plugged:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 19:00:35 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-e4ad0287-8a94-4ac0-ab54-2a5dd87357c0 req-880dcd14-1203-4083-a4cb-1d84e3ebb1c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044056 Apr 13 19:00:35 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 89/261] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:36 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e1714089-501b-4b96-b66e-03f9ab9f1b84 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:36 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e1714089-501b-4b96-b66e-03f9ab9f1b84 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e1714089-501b-4b96-b66e-03f9ab9f1b84 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e1714089-501b-4b96-b66e-03f9ab9f1b84 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e1714089-501b-4b96-b66e-03f9ab9f1b84 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e1714089-501b-4b96-b66e-03f9ab9f1b84 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e1714089-501b-4b96-b66e-03f9ab9f1b84 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e1714089-501b-4b96-b66e-03f9ab9f1b84 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:36 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-e1714089-501b-4b96-b66e-03f9ab9f1b84 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] HTTP exception thrown: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:36 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e1714089-501b-4b96-b66e-03f9ab9f1b84 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Request method failure captured: Apr 13 19:00:36 user devstack@n-api.service[61589]: request: DELETE /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583 HTTP/1.1 Apr 13 19:00:36 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:00:36 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:00:36 user devstack@n-api.service[61589]: Connection: close Apr 13 19:00:36 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:00:36 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:00:36 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:00:36 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:00:36 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBpZwx_4Q1LKbfXTpJnfsGqQ3IR9M4KcvHrqHSqafblHEf38Ruw_N-9YlV47HoIImU9n4hzibQdInN6U6ToFz4FV0plIiRLRNoIHpLWCGJzgI0SC2Emi4chn7aFEbxaLNr-WjwUXSQi7BnjYOrDn2QsLUCBFHMKWCfoLYiiGneAgO8 Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Project-Id: 0e7c45edf2a84f86b4c91c12edb8c66a Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-573903665 Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e7c45edf2a84f86b4c91c12edb8c66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0e7c45edf2a84f86b4c91c12edb8c66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e7c45edf2a84f86b4c91c12edb8c66a"}]}] Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Tenant: tempest-TaggedBootDevicesTest_v242-573903665 Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Tenant-Id: 0e7c45edf2a84f86b4c91c12edb8c66a Apr 13 19:00:36 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-573903665 Apr 13 19:00:36 user devstack@n-api.service[61589]: X-User: tempest-TaggedBootDevicesTest_v242-573903665-project-member Apr 13 19:00:36 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:00:36 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:00:36 user devstack@n-api.service[61589]: X-User-Id: f63a7e8a5a374e66b26f2309874c5adb Apr 13 19:00:36 user devstack@n-api.service[61589]: X-User-Name: tempest-TaggedBootDevicesTest_v242-573903665-project-member Apr 13 19:00:36 user devstack@n-api.service[61589]: method: > Apr 13 19:00:36 user devstack@n-api.service[61589]: exception: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:36 user devstack@n-api.service[61589]: action_args: {'id': 'c655dda4-2db1-4f7c-8591-bb0512122583'} Apr 13 19:00:36 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:00:36 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e1714089-501b-4b96-b66e-03f9ab9f1b84 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Returning 404 to user: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:00:36 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e1714089-501b-4b96-b66e-03f9ab9f1b84 tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583" status: 404 len: 111 microversion: 2.42 time: 0.043536 Apr 13 19:00:36 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 86/262] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:00:36 2023] DELETE /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:00:36 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-5e2a9404-16b5-41a3-a06a-2db7dd89790c tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:36 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-5e2a9404-16b5-41a3-a06a-2db7dd89790c tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5e2a9404-16b5-41a3-a06a-2db7dd89790c tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5e2a9404-16b5-41a3-a06a-2db7dd89790c tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5e2a9404-16b5-41a3-a06a-2db7dd89790c tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5e2a9404-16b5-41a3-a06a-2db7dd89790c tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5e2a9404-16b5-41a3-a06a-2db7dd89790c tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5e2a9404-16b5-41a3-a06a-2db7dd89790c tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:36 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-5e2a9404-16b5-41a3-a06a-2db7dd89790c tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] HTTP exception thrown: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:36 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-5e2a9404-16b5-41a3-a06a-2db7dd89790c tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Request method failure captured: Apr 13 19:00:36 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583 HTTP/1.1 Apr 13 19:00:36 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:00:36 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:00:36 user devstack@n-api.service[61588]: Connection: close Apr 13 19:00:36 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:00:36 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:00:36 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:00:36 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:00:36 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBpZwx_4Q1LKbfXTpJnfsGqQ3IR9M4KcvHrqHSqafblHEf38Ruw_N-9YlV47HoIImU9n4hzibQdInN6U6ToFz4FV0plIiRLRNoIHpLWCGJzgI0SC2Emi4chn7aFEbxaLNr-WjwUXSQi7BnjYOrDn2QsLUCBFHMKWCfoLYiiGneAgO8 Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Project-Id: 0e7c45edf2a84f86b4c91c12edb8c66a Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-573903665 Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e7c45edf2a84f86b4c91c12edb8c66a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0e7c45edf2a84f86b4c91c12edb8c66a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e7c45edf2a84f86b4c91c12edb8c66a"}]}] Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Tenant: tempest-TaggedBootDevicesTest_v242-573903665 Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Tenant-Id: 0e7c45edf2a84f86b4c91c12edb8c66a Apr 13 19:00:36 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-573903665 Apr 13 19:00:36 user devstack@n-api.service[61588]: X-User: tempest-TaggedBootDevicesTest_v242-573903665-project-member Apr 13 19:00:36 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:00:36 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:00:36 user devstack@n-api.service[61588]: X-User-Id: f63a7e8a5a374e66b26f2309874c5adb Apr 13 19:00:36 user devstack@n-api.service[61588]: X-User-Name: tempest-TaggedBootDevicesTest_v242-573903665-project-member Apr 13 19:00:36 user devstack@n-api.service[61588]: method: > Apr 13 19:00:36 user devstack@n-api.service[61588]: exception: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:36 user devstack@n-api.service[61588]: action_args: {'id': 'c655dda4-2db1-4f7c-8591-bb0512122583'} Apr 13 19:00:36 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. Apr 13 19:00:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:00:36 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-5e2a9404-16b5-41a3-a06a-2db7dd89790c tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Returning 404 to user: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:00:36 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-5e2a9404-16b5-41a3-a06a-2db7dd89790c tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583" status: 404 len: 111 microversion: 2.42 time: 0.029426 Apr 13 19:00:36 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 88/263] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:00:36 2023] GET /compute/v2.1/servers/c655dda4-2db1-4f7c-8591-bb0512122583 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-9c9d37c5-a6f8-4f2d-8c1d-f4d6c4aec7f5 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-9c9d37c5-a6f8-4f2d-8c1d-f4d6c4aec7f5 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9c9d37c5-a6f8-4f2d-8c1d-f4d6c4aec7f5 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9c9d37c5-a6f8-4f2d-8c1d-f4d6c4aec7f5 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9c9d37c5-a6f8-4f2d-8c1d-f4d6c4aec7f5 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9c9d37c5-a6f8-4f2d-8c1d-f4d6c4aec7f5 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9c9d37c5-a6f8-4f2d-8c1d-f4d6c4aec7f5 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9c9d37c5-a6f8-4f2d-8c1d-f4d6c4aec7f5 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-9c9d37c5-a6f8-4f2d-8c1d-f4d6c4aec7f5 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:00:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-9c9d37c5-a6f8-4f2d-8c1d-f4d6c4aec7f5 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1700 microversion: 2.1 time: 0.257537 Apr 13 19:00:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 90/264] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:00:42 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1700 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1417744922", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for project c162f91cba4b4ecf9de48fbf839da261. Resources: dict_keys(['metadata_items']) {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for user df209814208d415e9d414d39205aaad6 and project c162f91cba4b4ecf9de48fbf839da261. Resources: dict_keys(['metadata_items']) {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:00:42 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] Creating event network-changed:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 19:00:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074409 Apr 13 19:00:42 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 89/265] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:42 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/action" status: 202 len: 1157 microversion: 2.1 time: 0.424113 Apr 13 19:00:42 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 87/266] 10.0.0.210 () {64 vars in 1356 bytes} [Thu Apr 13 19:00:42 2023] POST /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/action => generated 1157 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-989f181c-4d3a-498c-83b5-d2ea19c392b4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-989f181c-4d3a-498c-83b5-d2ea19c392b4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-989f181c-4d3a-498c-83b5-d2ea19c392b4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-989f181c-4d3a-498c-83b5-d2ea19c392b4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-989f181c-4d3a-498c-83b5-d2ea19c392b4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-989f181c-4d3a-498c-83b5-d2ea19c392b4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-989f181c-4d3a-498c-83b5-d2ea19c392b4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-989f181c-4d3a-498c-83b5-d2ea19c392b4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:43 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-989f181c-4d3a-498c-83b5-d2ea19c392b4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:00:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-989f181c-4d3a-498c-83b5-d2ea19c392b4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1729 microversion: 2.1 time: 0.259125 Apr 13 19:00:43 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 91/267] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:00:42 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:00:44 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-unplugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}, {"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] Creating event network-vif-unplugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:00:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] Creating event network-vif-plugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:00:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.049716 Apr 13 19:00:44 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 90/268] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:44 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:47 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-bff79b0d-7cad-4add-bc0f-37e9d3999a83 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:00:47 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-bff79b0d-7cad-4add-bc0f-37e9d3999a83 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:00:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bff79b0d-7cad-4add-bc0f-37e9d3999a83 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bff79b0d-7cad-4add-bc0f-37e9d3999a83 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bff79b0d-7cad-4add-bc0f-37e9d3999a83 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bff79b0d-7cad-4add-bc0f-37e9d3999a83 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bff79b0d-7cad-4add-bc0f-37e9d3999a83 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bff79b0d-7cad-4add-bc0f-37e9d3999a83 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:47 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-bff79b0d-7cad-4add-bc0f-37e9d3999a83 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1ffe2f879f4c049b6c28d3a9623d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d708f05aa7c454bbf94931b6b5593bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:00:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-bff79b0d-7cad-4add-bc0f-37e9d3999a83 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888" status: 200 len: 1496 microversion: 2.1 time: 0.214118 Apr 13 19:00:47 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 88/269] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:00:47 2023] GET /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888 => generated 1496 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:00:52 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-1a05deac-977e-4923-8720-c008559a70a5 req-2d6d9c57-46b8-4ae3-bd73-bac6bb9285c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "name": "network-vif-plugged", "status": "completed", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-1a05deac-977e-4923-8720-c008559a70a5 req-2d6d9c57-46b8-4ae3-bd73-bac6bb9285c3 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-1a05deac-977e-4923-8720-c008559a70a5 req-2d6d9c57-46b8-4ae3-bd73-bac6bb9285c3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-1a05deac-977e-4923-8720-c008559a70a5 req-2d6d9c57-46b8-4ae3-bd73-bac6bb9285c3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:52 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-1a05deac-977e-4923-8720-c008559a70a5 req-2d6d9c57-46b8-4ae3-bd73-bac6bb9285c3 service nova] Creating event network-vif-plugged:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 19:00:52 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-1a05deac-977e-4923-8720-c008559a70a5 req-2d6d9c57-46b8-4ae3-bd73-bac6bb9285c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033425 Apr 13 19:00:52 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 92/270] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:54 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-c8820640-17f7-4f0c-bc02-dbde11e5483b req-16e93d21-1236-4925-888d-5ccf72662b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "name": "network-vif-plugged", "status": "completed", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-c8820640-17f7-4f0c-bc02-dbde11e5483b req-16e93d21-1236-4925-888d-5ccf72662b9e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-c8820640-17f7-4f0c-bc02-dbde11e5483b req-16e93d21-1236-4925-888d-5ccf72662b9e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-c8820640-17f7-4f0c-bc02-dbde11e5483b req-16e93d21-1236-4925-888d-5ccf72662b9e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:54 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-c8820640-17f7-4f0c-bc02-dbde11e5483b req-16e93d21-1236-4925-888d-5ccf72662b9e service nova] Creating event network-vif-plugged:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 19:00:54 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-c8820640-17f7-4f0c-bc02-dbde11e5483b req-16e93d21-1236-4925-888d-5ccf72662b9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047935 Apr 13 19:00:54 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 91/271] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:00:56 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}, {"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:00:56 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:00:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:00:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:00:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:00:56 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=7,nova_cell1:INSERT=4,nova_cell1:DELETE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:00:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] Creating event network-vif-plugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:00:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] Creating event network-vif-plugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:00:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038344 Apr 13 19:00:56 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 89/272] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:00:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=20 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1142942524", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "2e8ff947-529b-4387-b2c5-12c423cddf70"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] validate_networks() for [('2e8ff947-529b-4387-b2c5-12c423cddf70', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Getting quotas for project 94f74f6b4f68416ebdb496adc62a48ed. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Getting quotas for user d1b0d9cad8c64a8ea80420d5d8efe16f and project 94f74f6b4f68416ebdb496adc62a48ed. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:01:04 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:01:04 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.746961 Apr 13 19:01:04 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 93/273] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:01:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:01:04 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-dd6296c5-d21b-450e-a122-683587f2a101 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:01:04 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-dd6296c5-d21b-450e-a122-683587f2a101 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:01:04 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:04 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:04 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-dd6296c5-d21b-450e-a122-683587f2a101 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b0d9cad8c64a8ea80420d5d8efe16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f74f6b4f68416ebdb496adc62a48ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:01:04 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-dd6296c5-d21b-450e-a122-683587f2a101 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33b4d519-a2df-4278-afbc-4ce7637b04ab" status: 200 len: 1208 microversion: 2.1 time: 0.073931 Apr 13 19:01:04 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 92/274] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:01:04 2023] GET /compute/v2.1/servers/33b4d519-a2df-4278-afbc-4ce7637b04ab => generated 1208 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:01:07 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:07 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b4d519-a2df-4278-afbc-4ce7637b04ab", "tag": "83a60571-08e5-4d6e-8582-5ec7c0304ec1"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:01:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:07 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] Creating event network-changed:83a60571-08e5-4d6e-8582-5ec7c0304ec1 for instance 33b4d519-a2df-4278-afbc-4ce7637b04ab on user Apr 13 19:01:07 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036135 Apr 13 19:01:07 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 90/275] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:01:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:01:09 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-5cb0fe64-f730-4bc5-b7be-0bf7757c9170 req-4e75a57b-d2f4-480b-9733-7e496846f1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b4d519-a2df-4278-afbc-4ce7637b04ab", "name": "network-vif-plugged", "status": "completed", "tag": "83a60571-08e5-4d6e-8582-5ec7c0304ec1"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:01:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5cb0fe64-f730-4bc5-b7be-0bf7757c9170 req-4e75a57b-d2f4-480b-9733-7e496846f1e6 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5cb0fe64-f730-4bc5-b7be-0bf7757c9170 req-4e75a57b-d2f4-480b-9733-7e496846f1e6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5cb0fe64-f730-4bc5-b7be-0bf7757c9170 req-4e75a57b-d2f4-480b-9733-7e496846f1e6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:09 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-5cb0fe64-f730-4bc5-b7be-0bf7757c9170 req-4e75a57b-d2f4-480b-9733-7e496846f1e6 service nova] Creating event network-vif-plugged:83a60571-08e5-4d6e-8582-5ec7c0304ec1 for instance 33b4d519-a2df-4278-afbc-4ce7637b04ab on user Apr 13 19:01:09 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-5cb0fe64-f730-4bc5-b7be-0bf7757c9170 req-4e75a57b-d2f4-480b-9733-7e496846f1e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032408 Apr 13 19:01:09 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 94/276] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:01:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:01:12 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-0c8574c2-b9f3-4265-adeb-17ad79366854 req-6ef2ceb3-86cc-4b95-b22e-b987f7cb7681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b4d519-a2df-4278-afbc-4ce7637b04ab", "name": "network-vif-plugged", "status": "completed", "tag": "83a60571-08e5-4d6e-8582-5ec7c0304ec1"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:01:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0c8574c2-b9f3-4265-adeb-17ad79366854 req-6ef2ceb3-86cc-4b95-b22e-b987f7cb7681 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0c8574c2-b9f3-4265-adeb-17ad79366854 req-6ef2ceb3-86cc-4b95-b22e-b987f7cb7681 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0c8574c2-b9f3-4265-adeb-17ad79366854 req-6ef2ceb3-86cc-4b95-b22e-b987f7cb7681 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:12 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0c8574c2-b9f3-4265-adeb-17ad79366854 req-6ef2ceb3-86cc-4b95-b22e-b987f7cb7681 service nova] Creating event network-vif-plugged:83a60571-08e5-4d6e-8582-5ec7c0304ec1 for instance 33b4d519-a2df-4278-afbc-4ce7637b04ab on user Apr 13 19:01:12 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-0c8574c2-b9f3-4265-adeb-17ad79366854 req-6ef2ceb3-86cc-4b95-b22e-b987f7cb7681 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032923 Apr 13 19:01:12 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 93/277] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:01:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:01:14 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-1f379b1c-1108-4a98-84a1-efdecc0c44ed tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:01:14 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-1f379b1c-1108-4a98-84a1-efdecc0c44ed tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:01:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1f379b1c-1108-4a98-84a1-efdecc0c44ed tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1f379b1c-1108-4a98-84a1-efdecc0c44ed tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1f379b1c-1108-4a98-84a1-efdecc0c44ed tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1f379b1c-1108-4a98-84a1-efdecc0c44ed tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1f379b1c-1108-4a98-84a1-efdecc0c44ed tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1f379b1c-1108-4a98-84a1-efdecc0c44ed tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:14 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-1f379b1c-1108-4a98-84a1-efdecc0c44ed tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] HTTP exception thrown: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:01:14 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-1f379b1c-1108-4a98-84a1-efdecc0c44ed tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Request method failure captured: Apr 13 19:01:14 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb HTTP/1.1 Apr 13 19:01:14 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:01:14 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:01:14 user devstack@n-api.service[61589]: Connection: close Apr 13 19:01:14 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:01:14 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:01:14 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:01:14 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:01:14 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBotx2ZM_9G1ZGBLCrl4LdPuMuif2otYt97YnqmlwhHzUsK6HVbp_6Twn9eY83XPXsPwtTDlDzIlMAP_ZMUr1gwRn72lFZ01UPE7Lb3StrwzhEltbae1cO6LsZeUGsWFJGxIgFKBnSkheTVbPlpbDVQ6u6s0l1v4R20quh3bFT9M8M Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Project-Id: a1308cc4c5734de9a9fd83688c8da796 Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Project-Name: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1308cc4c5734de9a9fd83688c8da796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a1308cc4c5734de9a9fd83688c8da796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1308cc4c5734de9a9fd83688c8da796"}]}] Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Tenant: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Tenant-Id: a1308cc4c5734de9a9fd83688c8da796 Apr 13 19:01:14 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:01:14 user devstack@n-api.service[61589]: X-User: tempest-ServersNegativeTestJSON-1876599222-project-member Apr 13 19:01:14 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:01:14 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:01:14 user devstack@n-api.service[61589]: X-User-Id: 3e7f76b4b7fb4651b3bce0e72f8a4de6 Apr 13 19:01:14 user devstack@n-api.service[61589]: X-User-Name: tempest-ServersNegativeTestJSON-1876599222-project-member Apr 13 19:01:14 user devstack@n-api.service[61589]: method: > Apr 13 19:01:14 user devstack@n-api.service[61589]: exception: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:01:14 user devstack@n-api.service[61589]: action_args: {'id': '0d7ba594-cc5f-470e-9cd3-7ff90f341aeb'} Apr 13 19:01:14 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:01:14 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:01:14 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-1f379b1c-1108-4a98-84a1-efdecc0c44ed tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Returning 404 to user: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:01:14 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-1f379b1c-1108-4a98-84a1-efdecc0c44ed tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" status: 404 len: 111 microversion: 2.1 time: 0.031097 Apr 13 19:01:14 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 91/278] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:01:14 2023] GET /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:01:14 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1a42afd1-69b4-477b-b23a-0b25bc6437f6 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:01:14 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-1a42afd1-69b4-477b-b23a-0b25bc6437f6 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:01:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1a42afd1-69b4-477b-b23a-0b25bc6437f6 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1a42afd1-69b4-477b-b23a-0b25bc6437f6 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1a42afd1-69b4-477b-b23a-0b25bc6437f6 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1a42afd1-69b4-477b-b23a-0b25bc6437f6 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1a42afd1-69b4-477b-b23a-0b25bc6437f6 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1a42afd1-69b4-477b-b23a-0b25bc6437f6 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:14 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-1a42afd1-69b4-477b-b23a-0b25bc6437f6 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7f76b4b7fb4651b3bce0e72f8a4de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1308cc4c5734de9a9fd83688c8da796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:01:14 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-1a42afd1-69b4-477b-b23a-0b25bc6437f6 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a" status: 200 len: 1494 microversion: 2.1 time: 0.181218 Apr 13 19:01:14 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 95/279] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:01:14 2023] GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a => generated 1494 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:01:16 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:16 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e845365d-df94-4af0-a664-4f6e41870cf4 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:01:16 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e845365d-df94-4af0-a664-4f6e41870cf4 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:01:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e845365d-df94-4af0-a664-4f6e41870cf4 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e845365d-df94-4af0-a664-4f6e41870cf4 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e845365d-df94-4af0-a664-4f6e41870cf4 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e845365d-df94-4af0-a664-4f6e41870cf4 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e845365d-df94-4af0-a664-4f6e41870cf4 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e845365d-df94-4af0-a664-4f6e41870cf4 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:16 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-e845365d-df94-4af0-a664-4f6e41870cf4 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] HTTP exception thrown: Instance 570101b9-9c60-4c05-94ab-437a8a07d453 could not be found. Apr 13 19:01:16 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e845365d-df94-4af0-a664-4f6e41870cf4 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Request method failure captured: Apr 13 19:01:16 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453 HTTP/1.1 Apr 13 19:01:16 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:01:16 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:01:16 user devstack@n-api.service[61588]: Connection: close Apr 13 19:01:16 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:01:16 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:01:16 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:01:16 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:01:16 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBjkOHcC8trekDqv4dgRPsIO4k7HlUmZhsMQQ1I5kw9qnj1dUWULtuoYJ5DXZzeRc4hQxrY4542D8W983IopEkOTeaTTjUegWBXI82IeRAAkaBJdX9Stt5ccCADBAOhCparndRubpgEywLj4qtWgLIpzxiXdQn117FLAax3BPOh-bM Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Project-Id: dc420cebeb8945cea96fe22173ad2b5b Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Project-Name: tempest-TestVolumeSwap-65519151 Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dc420cebeb8945cea96fe22173ad2b5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dc420cebeb8945cea96fe22173ad2b5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dc420cebeb8945cea96fe22173ad2b5b"}]}] Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Tenant: tempest-TestVolumeSwap-65519151 Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Tenant-Id: dc420cebeb8945cea96fe22173ad2b5b Apr 13 19:01:16 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TestVolumeSwap-65519151 Apr 13 19:01:16 user devstack@n-api.service[61588]: X-User: tempest-TestVolumeSwap-65519151-project-member Apr 13 19:01:16 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:01:16 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:01:16 user devstack@n-api.service[61588]: X-User-Id: 3ff89f9a33e348e69d8a7e986100d421 Apr 13 19:01:16 user devstack@n-api.service[61588]: X-User-Name: tempest-TestVolumeSwap-65519151-project-member Apr 13 19:01:16 user devstack@n-api.service[61588]: method: > Apr 13 19:01:16 user devstack@n-api.service[61588]: exception: Instance 570101b9-9c60-4c05-94ab-437a8a07d453 could not be found. Apr 13 19:01:16 user devstack@n-api.service[61588]: action_args: {'id': '570101b9-9c60-4c05-94ab-437a8a07d453'} Apr 13 19:01:16 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570101b9-9c60-4c05-94ab-437a8a07d453 could not be found. Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570101b9-9c60-4c05-94ab-437a8a07d453 could not be found. Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570101b9-9c60-4c05-94ab-437a8a07d453 could not be found. Apr 13 19:01:16 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:01:16 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e845365d-df94-4af0-a664-4f6e41870cf4 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Returning 404 to user: Instance 570101b9-9c60-4c05-94ab-437a8a07d453 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:01:16 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e845365d-df94-4af0-a664-4f6e41870cf4 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453" status: 404 len: 111 microversion: 2.1 time: 0.031641 Apr 13 19:01:16 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 94/280] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:01:16 2023] GET /compute/v2.1/servers/570101b9-9c60-4c05-94ab-437a8a07d453 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 19:01:16 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-3bb6a57e-a2cf-42a1-be74-1b524ac36cb3 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Calling method '.version_select at 0x7efe33fb08b0>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:01:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-3bb6a57e-a2cf-42a1-be74-1b524ac36cb3 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823176268" status: 202 len: 0 microversion: 2.1 time: 0.021974 Apr 13 19:01:16 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 92/281] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 19:01:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823176268 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:01:18 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-adf7da3e-4a7b-4844-82c1-a3f27a5da675 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:01:18 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-adf7da3e-4a7b-4844-82c1-a3f27a5da675 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:01:18 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:18 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-adf7da3e-4a7b-4844-82c1-a3f27a5da675 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-adf7da3e-4a7b-4844-82c1-a3f27a5da675 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-adf7da3e-4a7b-4844-82c1-a3f27a5da675 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-adf7da3e-4a7b-4844-82c1-a3f27a5da675 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-adf7da3e-4a7b-4844-82c1-a3f27a5da675 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-adf7da3e-4a7b-4844-82c1-a3f27a5da675 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:18 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-adf7da3e-4a7b-4844-82c1-a3f27a5da675 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:01:18 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-adf7da3e-4a7b-4844-82c1-a3f27a5da675 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 200 len: 1700 microversion: 2.1 time: 0.308052 Apr 13 19:01:18 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 96/282] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:01:18 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 1700 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:01:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-584895b0-d22a-442e-a026-f654aaa0980c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:01:24 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-584895b0-d22a-442e-a026-f654aaa0980c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:01:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-584895b0-d22a-442e-a026-f654aaa0980c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-584895b0-d22a-442e-a026-f654aaa0980c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-584895b0-d22a-442e-a026-f654aaa0980c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-584895b0-d22a-442e-a026-f654aaa0980c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-584895b0-d22a-442e-a026-f654aaa0980c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-584895b0-d22a-442e-a026-f654aaa0980c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:24 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-584895b0-d22a-442e-a026-f654aaa0980c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:01:25 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-584895b0-d22a-442e-a026-f654aaa0980c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:01:25 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-584895b0-d22a-442e-a026-f654aaa0980c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:01:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-584895b0-d22a-442e-a026-f654aaa0980c tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f" status: 200 len: 1783 microversion: 2.20 time: 0.212253 Apr 13 19:01:25 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 95/283] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:01:24 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f => generated 1783 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:01:33 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=5 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:33 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:33 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-faae15e8-04f0-4d20-9498-adf3e7e31933 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:01:33 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-faae15e8-04f0-4d20-9498-adf3e7e31933 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:01:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-faae15e8-04f0-4d20-9498-adf3e7e31933 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-faae15e8-04f0-4d20-9498-adf3e7e31933 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-faae15e8-04f0-4d20-9498-adf3e7e31933 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-faae15e8-04f0-4d20-9498-adf3e7e31933 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-faae15e8-04f0-4d20-9498-adf3e7e31933 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-faae15e8-04f0-4d20-9498-adf3e7e31933 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:33 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-faae15e8-04f0-4d20-9498-adf3e7e31933 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:01:33 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-faae15e8-04f0-4d20-9498-adf3e7e31933 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1720 microversion: 2.1 time: 0.287882 Apr 13 19:01:33 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 93/284] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:01:33 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1720 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:01:45 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-7d8f82e3-6ed4-46e5-b8d5-f9304b45a73f tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Action: 'create', calling method: .version_select at 0x7efe382e7ac0>, body: {"keypair": {"name": "tempest-keypair-883887520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANNcqbVyx2+AlA6pJ67iCyDqokC0vj/8HKOcvYaotnci2ghezOK0wR9sJjzbtG6QMuvPDsNIPT54X8tzc1iHMAgDLsmrG5h7nHcBGX8mEcxODCqL7xCBPS67OL15k/VWg=="}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:01:45 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:45 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=16 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:45 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-7d8f82e3-6ed4-46e5-b8d5-f9304b45a73f tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Getting quotas for project ee3a4f50c893404b94c839e86a55b47c. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:01:45 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-7d8f82e3-6ed4-46e5-b8d5-f9304b45a73f tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Getting quotas for user 3ff67e015f5c4480919a0bd503abedc3 and project ee3a4f50c893404b94c839e86a55b47c. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:01:45 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-7d8f82e3-6ed4-46e5-b8d5-f9304b45a73f tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.051928 Apr 13 19:01:45 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 97/285] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 19:01:45 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 19:01:46 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-266550598", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275"}], "security_groups": [{"name": "tempest-securitygroup--793199802"}], "key_name": "tempest-keypair-883887520", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:01:46 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=10 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:46 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=10 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:46 user devstack@n-api.service[61588]: DEBUG nova.network.neutron [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] validate_networks() for [('3a84ff5b-fe4e-41eb-8cf9-6882fbec0275', None, None, None, None, None)] {{(pid=61588) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Flavor limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Image limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Flavor pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Image pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Getting quotas for project ee3a4f50c893404b94c839e86a55b47c. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Getting quotas for user 3ff67e015f5c4480919a0bd503abedc3 and project ee3a4f50c893404b94c839e86a55b47c. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Going to run 1 instances... {{(pid=61588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:01:47 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:01:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 0.585001 Apr 13 19:01:47 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 96/286] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 19:01:46 2023] POST /compute/v2.1/servers => generated 403 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 19:01:47 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e8dac819-de92-4dd6-bdb6-b08fc0ae7f6d tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:01:47 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e8dac819-de92-4dd6-bdb6-b08fc0ae7f6d tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:01:47 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:47 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:01:47 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-e8dac819-de92-4dd6-bdb6-b08fc0ae7f6d tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:01:47 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-e8dac819-de92-4dd6-bdb6-b08fc0ae7f6d tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:01:47 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-e8dac819-de92-4dd6-bdb6-b08fc0ae7f6d tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:01:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e8dac819-de92-4dd6-bdb6-b08fc0ae7f6d tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e" status: 200 len: 1319 microversion: 2.49 time: 0.085447 Apr 13 19:01:47 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 94/287] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:01:47 2023] GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e => generated 1319 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:01:48 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1b80c6d5-a445-4e3a-a6b7-2ff3b493269e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b5c3ad19-673d-49a1-b8ef-d5ee33554a56"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:01:48 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-1b80c6d5-a445-4e3a-a6b7-2ff3b493269e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:01:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1b80c6d5-a445-4e3a-a6b7-2ff3b493269e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1b80c6d5-a445-4e3a-a6b7-2ff3b493269e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1b80c6d5-a445-4e3a-a6b7-2ff3b493269e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1b80c6d5-a445-4e3a-a6b7-2ff3b493269e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1b80c6d5-a445-4e3a-a6b7-2ff3b493269e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1b80c6d5-a445-4e3a-a6b7-2ff3b493269e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:48 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-1b80c6d5-a445-4e3a-a6b7-2ff3b493269e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] HTTP exception thrown: Volume 3b64b1a7-88b0-4927-b2b0-ca07d68fd9fa could not be found. Apr 13 19:01:48 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1b80c6d5-a445-4e3a-a6b7-2ff3b493269e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Request method failure captured: Apr 13 19:01:48 user devstack@n-api.service[61587]: request: PUT /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888/os-volume_attachments/3b64b1a7-88b0-4927-b2b0-ca07d68fd9fa HTTP/1.1 Apr 13 19:01:48 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:01:48 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:01:48 user devstack@n-api.service[61587]: Connection: close Apr 13 19:01:48 user devstack@n-api.service[61587]: Content-Length: 74 Apr 13 19:01:48 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:01:48 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:01:48 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:01:48 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFB6laXF5juiTL92RqD2Jm8djcddv0WKhMRTHLSzN7ITIzRSmj8vODjhOm4gYe1o54ZyDCVwsVaqDP58eyiSGnPmkJjsinpvcE5gcUffKH3VKW6vXCXrPEnwd0dmV_DXYIOnDGS0y3mbpKhu8pBrYqmDL7nE9B8aggGIcsboy7vCdHw Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Project-Id: 8fa3eb8640204ca0b9f0e9af06123ba7 Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Project-Name: tempest-VolumesAdminNegativeTest-1148698299 Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Role: member,admin,reader Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Roles: member,admin,reader Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa3eb8640204ca0b9f0e9af06123ba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8fa3eb8640204ca0b9f0e9af06123ba7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8fa3eb8640204ca0b9f0e9af06123ba7"}]}] Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Tenant: tempest-VolumesAdminNegativeTest-1148698299 Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Tenant-Id: 8fa3eb8640204ca0b9f0e9af06123ba7 Apr 13 19:01:48 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1148698299 Apr 13 19:01:48 user devstack@n-api.service[61587]: X-User: tempest-VolumesAdminNegativeTest-1148698299-project-admin Apr 13 19:01:48 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:01:48 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:01:48 user devstack@n-api.service[61587]: X-User-Id: 3e977531fc2d4065b7761b969a02df97 Apr 13 19:01:48 user devstack@n-api.service[61587]: X-User-Name: tempest-VolumesAdminNegativeTest-1148698299-project-admin Apr 13 19:01:48 user devstack@n-api.service[61587]: Apr 13 19:01:48 user devstack@n-api.service[61587]: {"volumeAttachment": {"volumeId": "b5c3ad19-673d-49a1-b8ef-d5ee33554a56"}} Apr 13 19:01:48 user devstack@n-api.service[61587]: method: > Apr 13 19:01:48 user devstack@n-api.service[61587]: exception: Volume 3b64b1a7-88b0-4927-b2b0-ca07d68fd9fa could not be found. Apr 13 19:01:48 user devstack@n-api.service[61587]: action_args: {'server_id': '81690e5b-0bcc-4e7c-87b6-e51a30571888', 'id': '3b64b1a7-88b0-4927-b2b0-ca07d68fd9fa', 'body': {'volumeAttachment': {'volumeId': 'b5c3ad19-673d-49a1-b8ef-d5ee33554a56'}}} Apr 13 19:01:48 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b64b1a7-88b0-4927-b2b0-ca07d68fd9fa could not be found. (HTTP 404) (Request-ID: req-ed338754-4954-4727-a08c-bd8ea96d2014) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b64b1a7-88b0-4927-b2b0-ca07d68fd9fa could not be found. Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b64b1a7-88b0-4927-b2b0-ca07d68fd9fa could not be found. Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b64b1a7-88b0-4927-b2b0-ca07d68fd9fa could not be found. Apr 13 19:01:48 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:01:48 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1b80c6d5-a445-4e3a-a6b7-2ff3b493269e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] Returning 404 to user: Volume 3b64b1a7-88b0-4927-b2b0-ca07d68fd9fa could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:01:48 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-1b80c6d5-a445-4e3a-a6b7-2ff3b493269e tempest-VolumesAdminNegativeTest-1148698299 tempest-VolumesAdminNegativeTest-1148698299-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888/os-volume_attachments/3b64b1a7-88b0-4927-b2b0-ca07d68fd9fa" status: 404 len: 109 microversion: 2.1 time: 0.145442 Apr 13 19:01:48 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 98/288] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 19:01:48 2023] PUT /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888/os-volume_attachments/3b64b1a7-88b0-4927-b2b0-ca07d68fd9fa => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:01:50 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "tag": "b5d1f04b-5691-4b8b-a52c-d54bdb160292"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:01:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:50 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] Creating event network-changed:b5d1f04b-5691-4b8b-a52c-d54bdb160292 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:01:50 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082007 Apr 13 19:01:50 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 97/289] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:01:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:01:51 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:01:51 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:01:51 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:51 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:51 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:51 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:51 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:51 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:51 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Going to try to terminate instance {{(pid=61589) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:01:51 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888" status: 204 len: 0 microversion: 2.1 time: 0.155968 Apr 13 19:01:51 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 95/290] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:01:51 2023] DELETE /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:01:51 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-b60b3335-3483-42de-9220-ab78a077c366 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:01:51 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-b60b3335-3483-42de-9220-ab78a077c366 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:01:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b60b3335-3483-42de-9220-ab78a077c366 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b60b3335-3483-42de-9220-ab78a077c366 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b60b3335-3483-42de-9220-ab78a077c366 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b60b3335-3483-42de-9220-ab78a077c366 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b60b3335-3483-42de-9220-ab78a077c366 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b60b3335-3483-42de-9220-ab78a077c366 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:51 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-b60b3335-3483-42de-9220-ab78a077c366 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1ffe2f879f4c049b6c28d3a9623d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d708f05aa7c454bbf94931b6b5593bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:01:51 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-b60b3335-3483-42de-9220-ab78a077c366 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888" status: 200 len: 1502 microversion: 2.1 time: 0.272624 Apr 13 19:01:51 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 99/291] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:01:51 2023] GET /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888 => generated 1502 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:01:51 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-f7b93612-ab00-45ae-9f63-baa2b545d7e1 req-cc017c3f-a8aa-4cb8-864a-199f2e02a299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81690e5b-0bcc-4e7c-87b6-e51a30571888", "name": "network-vif-unplugged", "status": "completed", "tag": "97015895-15bd-401e-aa52-776f82605bc4"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:01:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-f7b93612-ab00-45ae-9f63-baa2b545d7e1 req-cc017c3f-a8aa-4cb8-864a-199f2e02a299 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-f7b93612-ab00-45ae-9f63-baa2b545d7e1 req-cc017c3f-a8aa-4cb8-864a-199f2e02a299 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-f7b93612-ab00-45ae-9f63-baa2b545d7e1 req-cc017c3f-a8aa-4cb8-864a-199f2e02a299 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:51 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-f7b93612-ab00-45ae-9f63-baa2b545d7e1 req-cc017c3f-a8aa-4cb8-864a-199f2e02a299 service nova] Creating event network-vif-unplugged:97015895-15bd-401e-aa52-776f82605bc4 for instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 on user Apr 13 19:01:51 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-f7b93612-ab00-45ae-9f63-baa2b545d7e1 req-cc017c3f-a8aa-4cb8-864a-199f2e02a299 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100706 Apr 13 19:01:51 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 98/292] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:01:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:01:53 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-91035c19-8b90-41cc-ab17-02c5ee5c037e req-613fca1e-1315-442f-ab37-3ae60ef0d1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81690e5b-0bcc-4e7c-87b6-e51a30571888", "name": "network-vif-deleted", "tag": "97015895-15bd-401e-aa52-776f82605bc4"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:01:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-91035c19-8b90-41cc-ab17-02c5ee5c037e req-613fca1e-1315-442f-ab37-3ae60ef0d1c6 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-91035c19-8b90-41cc-ab17-02c5ee5c037e req-613fca1e-1315-442f-ab37-3ae60ef0d1c6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-91035c19-8b90-41cc-ab17-02c5ee5c037e req-613fca1e-1315-442f-ab37-3ae60ef0d1c6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-91035c19-8b90-41cc-ab17-02c5ee5c037e req-613fca1e-1315-442f-ab37-3ae60ef0d1c6 service nova] Creating event network-vif-deleted:97015895-15bd-401e-aa52-776f82605bc4 for instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 on user Apr 13 19:01:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-91035c19-8b90-41cc-ab17-02c5ee5c037e req-613fca1e-1315-442f-ab37-3ae60ef0d1c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035285 Apr 13 19:01:53 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 96/293] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:01:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:01:53 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81690e5b-0bcc-4e7c-87b6-e51a30571888", "name": "network-vif-plugged", "status": "completed", "tag": "97015895-15bd-401e-aa52-776f82605bc4"}, {"server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "name": "network-vif-plugged", "status": "completed", "tag": "b5d1f04b-5691-4b8b-a52c-d54bdb160292"}, {"server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "name": "network-vif-plugged", "status": "completed", "tag": "b5d1f04b-5691-4b8b-a52c-d54bdb160292"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:01:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Creating event network-vif-plugged:97015895-15bd-401e-aa52-776f82605bc4 for instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 on user Apr 13 19:01:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Creating event network-vif-plugged:b5d1f04b-5691-4b8b-a52c-d54bdb160292 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:01:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Creating event network-vif-plugged:b5d1f04b-5691-4b8b-a52c-d54bdb160292 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:01:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035955 Apr 13 19:01:53 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 100/294] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:01:53 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:01:55 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-33b12a45-2ae0-4850-b5c6-09337cc869f9 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:01:55 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-33b12a45-2ae0-4850-b5c6-09337cc869f9 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:01:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-33b12a45-2ae0-4850-b5c6-09337cc869f9 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-33b12a45-2ae0-4850-b5c6-09337cc869f9 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-33b12a45-2ae0-4850-b5c6-09337cc869f9 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-33b12a45-2ae0-4850-b5c6-09337cc869f9 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:01:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-33b12a45-2ae0-4850-b5c6-09337cc869f9 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:01:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-33b12a45-2ae0-4850-b5c6-09337cc869f9 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:01:55 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-33b12a45-2ae0-4850-b5c6-09337cc869f9 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b0d9cad8c64a8ea80420d5d8efe16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f74f6b4f68416ebdb496adc62a48ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:01:55 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-33b12a45-2ae0-4850-b5c6-09337cc869f9 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33b4d519-a2df-4278-afbc-4ce7637b04ab" status: 200 len: 1485 microversion: 2.1 time: 0.160595 Apr 13 19:01:55 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 99/295] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:01:55 2023] GET /compute/v2.1/servers/33b4d519-a2df-4278-afbc-4ce7637b04ab => generated 1485 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:02:16 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:16 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:16 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:16 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-bc23d387-5d4f-4d90-9c79-6f15c85d0f4b tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-610044851", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b1e7e839-5330-47a4-8b0f-6e150f066ee7", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f"}]}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:02:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-bc23d387-5d4f-4d90-9c79-6f15c85d0f4b tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] HTTP exception thrown: Block Device b1e7e839-5330-47a4-8b0f-6e150f066ee7 is not bootable. Apr 13 19:02:16 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-bc23d387-5d4f-4d90-9c79-6f15c85d0f4b tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Request method failure captured: Apr 13 19:02:16 user devstack@n-api.service[61589]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 19:02:16 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:02:16 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:02:16 user devstack@n-api.service[61589]: Connection: close Apr 13 19:02:16 user devstack@n-api.service[61589]: Content-Length: 356 Apr 13 19:02:16 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:02:16 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:02:16 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:02:16 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBotx2ZM_9G1ZGBLCrl4LdPuMuif2otYt97YnqmlwhHzUsK6HVbp_6Twn9eY83XPXsPwtTDlDzIlMAP_ZMUr1gwRn72lFZ01UPE7Lb3StrwzhEltbae1cO6LsZeUGsWFJGxIgFKBnSkheTVbPlpbDVQ6u6s0l1v4R20quh3bFT9M8M Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Project-Id: a1308cc4c5734de9a9fd83688c8da796 Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Project-Name: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1308cc4c5734de9a9fd83688c8da796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a1308cc4c5734de9a9fd83688c8da796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1308cc4c5734de9a9fd83688c8da796"}]}] Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Tenant: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Tenant-Id: a1308cc4c5734de9a9fd83688c8da796 Apr 13 19:02:16 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:02:16 user devstack@n-api.service[61589]: X-User: tempest-ServersNegativeTestJSON-1876599222-project-member Apr 13 19:02:16 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:02:16 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:02:16 user devstack@n-api.service[61589]: X-User-Id: 3e7f76b4b7fb4651b3bce0e72f8a4de6 Apr 13 19:02:16 user devstack@n-api.service[61589]: X-User-Name: tempest-ServersNegativeTestJSON-1876599222-project-member Apr 13 19:02:16 user devstack@n-api.service[61589]: Apr 13 19:02:16 user devstack@n-api.service[61589]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-610044851", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b1e7e839-5330-47a4-8b0f-6e150f066ee7", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f"}]}} Apr 13 19:02:16 user devstack@n-api.service[61589]: method: > Apr 13 19:02:16 user devstack@n-api.service[61589]: exception: Block Device b1e7e839-5330-47a4-8b0f-6e150f066ee7 is not bootable. Apr 13 19:02:16 user devstack@n-api.service[61589]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-610044851', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'b1e7e839-5330-47a4-8b0f-6e150f066ee7'}], 'networks': [{'uuid': 'ae895ef0-18d7-4f77-bcc6-bcb3dd22026f'}]}}} Apr 13 19:02:16 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device b1e7e839-5330-47a4-8b0f-6e150f066ee7 is not bootable. Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device b1e7e839-5330-47a4-8b0f-6e150f066ee7 is not bootable. Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device b1e7e839-5330-47a4-8b0f-6e150f066ee7 is not bootable. Apr 13 19:02:16 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:02:16 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-bc23d387-5d4f-4d90-9c79-6f15c85d0f4b tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Returning 400 to user: Block Device b1e7e839-5330-47a4-8b0f-6e150f066ee7 is not bootable. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:02:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-bc23d387-5d4f-4d90-9c79-6f15c85d0f4b tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.092330 Apr 13 19:02:16 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 97/296] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:02:16 2023] POST /compute/v2.1/servers => generated 110 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:02:16 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:16 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:16 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=12 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:16 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-23c6de23-e056-4b9c-a56d-385a112e4e1d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:16 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-23c6de23-e056-4b9c-a56d-385a112e4e1d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-23c6de23-e056-4b9c-a56d-385a112e4e1d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-23c6de23-e056-4b9c-a56d-385a112e4e1d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-23c6de23-e056-4b9c-a56d-385a112e4e1d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-23c6de23-e056-4b9c-a56d-385a112e4e1d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-23c6de23-e056-4b9c-a56d-385a112e4e1d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-23c6de23-e056-4b9c-a56d-385a112e4e1d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:16 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-23c6de23-e056-4b9c-a56d-385a112e4e1d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7f76b4b7fb4651b3bce0e72f8a4de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1308cc4c5734de9a9fd83688c8da796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:02:16 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-23c6de23-e056-4b9c-a56d-385a112e4e1d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a" status: 200 len: 1494 microversion: 2.1 time: 0.174330 Apr 13 19:02:16 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 101/297] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:02:16 2023] GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a => generated 1494 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:02:18 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:18 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:18 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:18 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=12 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:19 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:19 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:19 user devstack@n-api.service[61588]: DEBUG nova.objects.instance [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'services' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=61588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:02:19 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/os-volume_attachments/e0036a0d-e82a-4dee-b536-e4252af1ca02" status: 202 len: 0 microversion: 2.1 time: 0.257848 Apr 13 19:02:19 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 100/298] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:02:18 2023] DELETE /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/os-volume_attachments/e0036a0d-e82a-4dee-b536-e4252af1ca02 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:02:21 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:02:21 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:21 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:21 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:21 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Going to try to stop instance {{(pid=61589) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 19:02:21 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/action" status: 202 len: 0 microversion: 2.1 time: 0.078945 Apr 13 19:02:21 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 98/299] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:02:21 2023] POST /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:02:21 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-4d9590bd-5bc6-4249-a58a-eb22131cf751 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:21 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-4d9590bd-5bc6-4249-a58a-eb22131cf751 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4d9590bd-5bc6-4249-a58a-eb22131cf751 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4d9590bd-5bc6-4249-a58a-eb22131cf751 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4d9590bd-5bc6-4249-a58a-eb22131cf751 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4d9590bd-5bc6-4249-a58a-eb22131cf751 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4d9590bd-5bc6-4249-a58a-eb22131cf751 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4d9590bd-5bc6-4249-a58a-eb22131cf751 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:21 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-4d9590bd-5bc6-4249-a58a-eb22131cf751 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:02:21 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-4d9590bd-5bc6-4249-a58a-eb22131cf751 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 200 len: 1664 microversion: 2.1 time: 0.193553 Apr 13 19:02:21 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 102/300] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:02:21 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 1664 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:02:21 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-5a7099a8-1411-41e9-9c5c-4fbeae4ae555 req-f815565e-abe4-4f18-8490-d81d7f45db20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-unplugged", "status": "completed", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:02:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-5a7099a8-1411-41e9-9c5c-4fbeae4ae555 req-f815565e-abe4-4f18-8490-d81d7f45db20 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-5a7099a8-1411-41e9-9c5c-4fbeae4ae555 req-f815565e-abe4-4f18-8490-d81d7f45db20 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-5a7099a8-1411-41e9-9c5c-4fbeae4ae555 req-f815565e-abe4-4f18-8490-d81d7f45db20 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:21 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5a7099a8-1411-41e9-9c5c-4fbeae4ae555 req-f815565e-abe4-4f18-8490-d81d7f45db20 service nova] Creating event network-vif-unplugged:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 19:02:21 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-5a7099a8-1411-41e9-9c5c-4fbeae4ae555 req-f815565e-abe4-4f18-8490-d81d7f45db20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092374 Apr 13 19:02:21 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 101/301] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:02:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:02:23 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-b5536dfd-ce3e-43bd-b028-b0e7acba41f5 req-ecda7242-e818-46ea-aa39-5e97b26bf241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-plugged", "status": "completed", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:02:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b5536dfd-ce3e-43bd-b028-b0e7acba41f5 req-ecda7242-e818-46ea-aa39-5e97b26bf241 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b5536dfd-ce3e-43bd-b028-b0e7acba41f5 req-ecda7242-e818-46ea-aa39-5e97b26bf241 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b5536dfd-ce3e-43bd-b028-b0e7acba41f5 req-ecda7242-e818-46ea-aa39-5e97b26bf241 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-b5536dfd-ce3e-43bd-b028-b0e7acba41f5 req-ecda7242-e818-46ea-aa39-5e97b26bf241 service nova] Creating event network-vif-plugged:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 19:02:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-b5536dfd-ce3e-43bd-b028-b0e7acba41f5 req-ecda7242-e818-46ea-aa39-5e97b26bf241 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033433 Apr 13 19:02:23 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 99/302] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:02:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:02:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-26e00151-414f-4463-982e-98f800a54d41 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:25 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-26e00151-414f-4463-982e-98f800a54d41 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-26e00151-414f-4463-982e-98f800a54d41 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-26e00151-414f-4463-982e-98f800a54d41 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-26e00151-414f-4463-982e-98f800a54d41 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-26e00151-414f-4463-982e-98f800a54d41 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-26e00151-414f-4463-982e-98f800a54d41 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-26e00151-414f-4463-982e-98f800a54d41 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-26e00151-414f-4463-982e-98f800a54d41 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/os-volume_attachments/20b015e0-df81-41d5-a1fa-0e7666672a88" status: 200 len: 194 microversion: 2.20 time: 0.136125 Apr 13 19:02:25 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 103/303] 10.0.0.210 () {64 vars in 1531 bytes} [Thu Apr 13 19:02:25 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/os-volume_attachments/20b015e0-df81-41d5-a1fa-0e7666672a88 => generated 194 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 19:02:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:25 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:25 user devstack@n-api.service[61588]: DEBUG nova.objects.instance [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'services' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=61588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:02:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/os-volume_attachments/20b015e0-df81-41d5-a1fa-0e7666672a88" status: 202 len: 0 microversion: 2.20 time: 0.162525 Apr 13 19:02:25 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 102/304] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 19:02:25 2023] DELETE /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/os-volume_attachments/20b015e0-df81-41d5-a1fa-0e7666672a88 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:02:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-2445f67a-c715-4c95-876c-ce4b9ed4f2f8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:25 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-2445f67a-c715-4c95-876c-ce4b9ed4f2f8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2445f67a-c715-4c95-876c-ce4b9ed4f2f8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2445f67a-c715-4c95-876c-ce4b9ed4f2f8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2445f67a-c715-4c95-876c-ce4b9ed4f2f8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2445f67a-c715-4c95-876c-ce4b9ed4f2f8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2445f67a-c715-4c95-876c-ce4b9ed4f2f8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2445f67a-c715-4c95-876c-ce4b9ed4f2f8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-2445f67a-c715-4c95-876c-ce4b9ed4f2f8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045912 Apr 13 19:02:25 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 100/305] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 19:02:25 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 19:02:33 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-8741e490-ed3c-42ba-ab03-6c0e20629184 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:33 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-8741e490-ed3c-42ba-ab03-6c0e20629184 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8741e490-ed3c-42ba-ab03-6c0e20629184 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8741e490-ed3c-42ba-ab03-6c0e20629184 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8741e490-ed3c-42ba-ab03-6c0e20629184 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8741e490-ed3c-42ba-ab03-6c0e20629184 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8741e490-ed3c-42ba-ab03-6c0e20629184 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8741e490-ed3c-42ba-ab03-6c0e20629184 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:33 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-8741e490-ed3c-42ba-ab03-6c0e20629184 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:02:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-8741e490-ed3c-42ba-ab03-6c0e20629184 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1720 microversion: 2.1 time: 0.289370 Apr 13 19:02:33 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 104/306] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:02:33 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1720 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:02:33 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-98c7d30f-7774-4526-846f-c9185a8a17b1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:33 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-98c7d30f-7774-4526-846f-c9185a8a17b1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-98c7d30f-7774-4526-846f-c9185a8a17b1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-98c7d30f-7774-4526-846f-c9185a8a17b1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-98c7d30f-7774-4526-846f-c9185a8a17b1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-98c7d30f-7774-4526-846f-c9185a8a17b1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-98c7d30f-7774-4526-846f-c9185a8a17b1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-98c7d30f-7774-4526-846f-c9185a8a17b1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:34 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-98c7d30f-7774-4526-846f-c9185a8a17b1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:02:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-98c7d30f-7774-4526-846f-c9185a8a17b1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1720 microversion: 2.1 time: 0.163451 Apr 13 19:02:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 103/307] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:02:33 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-5bf93030-5675-4029-b54c-7bf974933070 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-5bf93030-5675-4029-b54c-7bf974933070 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=8 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5bf93030-5675-4029-b54c-7bf974933070 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5bf93030-5675-4029-b54c-7bf974933070 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5bf93030-5675-4029-b54c-7bf974933070 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5bf93030-5675-4029-b54c-7bf974933070 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5bf93030-5675-4029-b54c-7bf974933070 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5bf93030-5675-4029-b54c-7bf974933070 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-5bf93030-5675-4029-b54c-7bf974933070 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-5bf93030-5675-4029-b54c-7bf974933070 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:02:37 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-5bf93030-5675-4029-b54c-7bf974933070 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:02:37 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-5bf93030-5675-4029-b54c-7bf974933070 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e" status: 200 len: 1625 microversion: 2.49 time: 0.149761 Apr 13 19:02:37 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 101/308] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:02:37 2023] GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e => generated 1625 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:02:41 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-277cb424-d248-4c81-9ad1-7b8d47fbb725 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:41 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-277cb424-d248-4c81-9ad1-7b8d47fbb725 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-277cb424-d248-4c81-9ad1-7b8d47fbb725 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-277cb424-d248-4c81-9ad1-7b8d47fbb725 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-277cb424-d248-4c81-9ad1-7b8d47fbb725 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-277cb424-d248-4c81-9ad1-7b8d47fbb725 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-277cb424-d248-4c81-9ad1-7b8d47fbb725 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-277cb424-d248-4c81-9ad1-7b8d47fbb725 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:41 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-277cb424-d248-4c81-9ad1-7b8d47fbb725 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] HTTP exception thrown: Instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 could not be found. Apr 13 19:02:41 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-277cb424-d248-4c81-9ad1-7b8d47fbb725 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Request method failure captured: Apr 13 19:02:41 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888 HTTP/1.1 Apr 13 19:02:41 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:02:41 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:02:41 user devstack@n-api.service[61587]: Connection: close Apr 13 19:02:41 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:02:41 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:02:41 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:02:41 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:02:41 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBsQ1tqhEyNzJ6vrT13lin_rpFKqO8ZSBvUyRhOrmleEMRge0bdK1lCxFcUXLVOYcGEisGkhDYg0v_LCjtunFR8U6Pg29pzsJftLM3PptF3YMkZiHpchTbnBB8E8nIifR6qXdSchj4l_VQwE2vTTvBMoneW1InKd4Le336LMZvxFMo Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Project-Id: 0d708f05aa7c454bbf94931b6b5593bf Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Project-Name: tempest-VolumesAdminNegativeTest-947401316 Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d708f05aa7c454bbf94931b6b5593bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d708f05aa7c454bbf94931b6b5593bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d708f05aa7c454bbf94931b6b5593bf"}]}] Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Tenant: tempest-VolumesAdminNegativeTest-947401316 Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Tenant-Id: 0d708f05aa7c454bbf94931b6b5593bf Apr 13 19:02:41 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-947401316 Apr 13 19:02:41 user devstack@n-api.service[61587]: X-User: tempest-VolumesAdminNegativeTest-947401316-project-member Apr 13 19:02:41 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:02:41 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:02:41 user devstack@n-api.service[61587]: X-User-Id: 3e1ffe2f879f4c049b6c28d3a9623d14 Apr 13 19:02:41 user devstack@n-api.service[61587]: X-User-Name: tempest-VolumesAdminNegativeTest-947401316-project-member Apr 13 19:02:41 user devstack@n-api.service[61587]: method: > Apr 13 19:02:41 user devstack@n-api.service[61587]: exception: Instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 could not be found. Apr 13 19:02:41 user devstack@n-api.service[61587]: action_args: {'id': '81690e5b-0bcc-4e7c-87b6-e51a30571888'} Apr 13 19:02:41 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 could not be found. Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 could not be found. Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 could not be found. Apr 13 19:02:41 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:02:41 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-277cb424-d248-4c81-9ad1-7b8d47fbb725 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Returning 404 to user: Instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:02:41 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-277cb424-d248-4c81-9ad1-7b8d47fbb725 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888" status: 404 len: 111 microversion: 2.1 time: 0.166962 Apr 13 19:02:41 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 105/309] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:02:41 2023] GET /compute/v2.1/servers/81690e5b-0bcc-4e7c-87b6-e51a30571888 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:02:43 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:43 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:43 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:02:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61" status: 204 len: 0 microversion: 2.1 time: 0.125616 Apr 13 19:02:44 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 104/310] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:02:43 2023] DELETE /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:02:44 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-33f8b02b-aee6-445c-83b6-a7b364ffdbb7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:44 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-33f8b02b-aee6-445c-83b6-a7b364ffdbb7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-33f8b02b-aee6-445c-83b6-a7b364ffdbb7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-33f8b02b-aee6-445c-83b6-a7b364ffdbb7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-33f8b02b-aee6-445c-83b6-a7b364ffdbb7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-33f8b02b-aee6-445c-83b6-a7b364ffdbb7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-33f8b02b-aee6-445c-83b6-a7b364ffdbb7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-33f8b02b-aee6-445c-83b6-a7b364ffdbb7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:44 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-33f8b02b-aee6-445c-83b6-a7b364ffdbb7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e1ffe2f879f4c049b6c28d3a9623d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d708f05aa7c454bbf94931b6b5593bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:02:44 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-33f8b02b-aee6-445c-83b6-a7b364ffdbb7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61" status: 200 len: 1669 microversion: 2.1 time: 0.224523 Apr 13 19:02:44 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 102/311] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:02:44 2023] GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61 => generated 1669 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:02:44 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-c4c0992f-8dd1-421c-ab50-111cf0b0a2bc req-975c77a8-8b5d-4268-a0ed-0f9f37acd69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "106da0b9-c823-4f26-874c-53f8ad235e61", "name": "network-vif-unplugged", "status": "completed", "tag": "8638d612-5f79-496f-8be2-db6706c14211"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:02:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-c4c0992f-8dd1-421c-ab50-111cf0b0a2bc req-975c77a8-8b5d-4268-a0ed-0f9f37acd69d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-c4c0992f-8dd1-421c-ab50-111cf0b0a2bc req-975c77a8-8b5d-4268-a0ed-0f9f37acd69d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-c4c0992f-8dd1-421c-ab50-111cf0b0a2bc req-975c77a8-8b5d-4268-a0ed-0f9f37acd69d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:44 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-c4c0992f-8dd1-421c-ab50-111cf0b0a2bc req-975c77a8-8b5d-4268-a0ed-0f9f37acd69d service nova] Creating event network-vif-unplugged:8638d612-5f79-496f-8be2-db6706c14211 for instance 106da0b9-c823-4f26-874c-53f8ad235e61 on user Apr 13 19:02:44 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-c4c0992f-8dd1-421c-ab50-111cf0b0a2bc req-975c77a8-8b5d-4268-a0ed-0f9f37acd69d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031093 Apr 13 19:02:44 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 106/312] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:02:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:02:45 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-af5d4c19-d835-4e8b-94dc-43a8e6741c18 req-7642a994-c301-48c2-8d3c-9cef30750537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "106da0b9-c823-4f26-874c-53f8ad235e61", "name": "network-vif-deleted", "tag": "8638d612-5f79-496f-8be2-db6706c14211"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:02:45 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-af5d4c19-d835-4e8b-94dc-43a8e6741c18 req-7642a994-c301-48c2-8d3c-9cef30750537 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:45 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-af5d4c19-d835-4e8b-94dc-43a8e6741c18 req-7642a994-c301-48c2-8d3c-9cef30750537 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:45 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-af5d4c19-d835-4e8b-94dc-43a8e6741c18 req-7642a994-c301-48c2-8d3c-9cef30750537 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:45 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-af5d4c19-d835-4e8b-94dc-43a8e6741c18 req-7642a994-c301-48c2-8d3c-9cef30750537 service nova] Creating event network-vif-deleted:8638d612-5f79-496f-8be2-db6706c14211 for instance 106da0b9-c823-4f26-874c-53f8ad235e61 on user Apr 13 19:02:45 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-af5d4c19-d835-4e8b-94dc-43a8e6741c18 req-7642a994-c301-48c2-8d3c-9cef30750537 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028720 Apr 13 19:02:45 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 105/313] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:02:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:02:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-d15c6581-2493-4bf3-b343-c4a8100d4e8e req-4af94fd5-ac50-4999-a52b-1cc68aac5baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "106da0b9-c823-4f26-874c-53f8ad235e61", "name": "network-vif-plugged", "status": "completed", "tag": "8638d612-5f79-496f-8be2-db6706c14211"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:02:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-d15c6581-2493-4bf3-b343-c4a8100d4e8e req-4af94fd5-ac50-4999-a52b-1cc68aac5baa service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-d15c6581-2493-4bf3-b343-c4a8100d4e8e req-4af94fd5-ac50-4999-a52b-1cc68aac5baa service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-d15c6581-2493-4bf3-b343-c4a8100d4e8e req-4af94fd5-ac50-4999-a52b-1cc68aac5baa service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:46 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-d15c6581-2493-4bf3-b343-c4a8100d4e8e req-4af94fd5-ac50-4999-a52b-1cc68aac5baa service nova] Creating event network-vif-plugged:8638d612-5f79-496f-8be2-db6706c14211 for instance 106da0b9-c823-4f26-874c-53f8ad235e61 on user Apr 13 19:02:46 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-d15c6581-2493-4bf3-b343-c4a8100d4e8e req-4af94fd5-ac50-4999-a52b-1cc68aac5baa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031805 Apr 13 19:02:46 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 103/314] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:02:59 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=12 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:59 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=28 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:59 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:59 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:59 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:02:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/33b4d519-a2df-4278-afbc-4ce7637b04ab" status: 204 len: 0 microversion: 2.1 time: 0.120750 Apr 13 19:02:59 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 107/315] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:02:59 2023] DELETE /compute/v2.1/servers/33b4d519-a2df-4278-afbc-4ce7637b04ab => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:02:59 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:59 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:02:59 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ed5b52ae-3195-4186-b053-3780584a08a8 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:02:59 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ed5b52ae-3195-4186-b053-3780584a08a8 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:02:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ed5b52ae-3195-4186-b053-3780584a08a8 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ed5b52ae-3195-4186-b053-3780584a08a8 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ed5b52ae-3195-4186-b053-3780584a08a8 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:02:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ed5b52ae-3195-4186-b053-3780584a08a8 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:02:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ed5b52ae-3195-4186-b053-3780584a08a8 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:02:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ed5b52ae-3195-4186-b053-3780584a08a8 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:00 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-ed5b52ae-3195-4186-b053-3780584a08a8 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b0d9cad8c64a8ea80420d5d8efe16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f74f6b4f68416ebdb496adc62a48ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:03:00 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-ed5b52ae-3195-4186-b053-3780584a08a8 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33b4d519-a2df-4278-afbc-4ce7637b04ab" status: 200 len: 1491 microversion: 2.1 time: 0.211661 Apr 13 19:03:00 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 106/316] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:02:59 2023] GET /compute/v2.1/servers/33b4d519-a2df-4278-afbc-4ce7637b04ab => generated 1491 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:03:00 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:00 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=14 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:00 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-a2db8ab1-0f09-4fd3-941c-9928886f9ffd req-90676121-93ff-4b7e-9903-91c6caa96e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b4d519-a2df-4278-afbc-4ce7637b04ab", "name": "network-vif-unplugged", "status": "completed", "tag": "83a60571-08e5-4d6e-8582-5ec7c0304ec1"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:00 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a2db8ab1-0f09-4fd3-941c-9928886f9ffd req-90676121-93ff-4b7e-9903-91c6caa96e3e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:00 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a2db8ab1-0f09-4fd3-941c-9928886f9ffd req-90676121-93ff-4b7e-9903-91c6caa96e3e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:00 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a2db8ab1-0f09-4fd3-941c-9928886f9ffd req-90676121-93ff-4b7e-9903-91c6caa96e3e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:00 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-a2db8ab1-0f09-4fd3-941c-9928886f9ffd req-90676121-93ff-4b7e-9903-91c6caa96e3e service nova] Creating event network-vif-unplugged:83a60571-08e5-4d6e-8582-5ec7c0304ec1 for instance 33b4d519-a2df-4278-afbc-4ce7637b04ab on user Apr 13 19:03:00 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-a2db8ab1-0f09-4fd3-941c-9928886f9ffd req-90676121-93ff-4b7e-9903-91c6caa96e3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043781 Apr 13 19:03:00 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 104/317] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:02 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b4d519-a2df-4278-afbc-4ce7637b04ab", "name": "network-vif-plugged", "status": "completed", "tag": "83a60571-08e5-4d6e-8582-5ec7c0304ec1"}, {"server_uuid": "33b4d519-a2df-4278-afbc-4ce7637b04ab", "name": "network-vif-deleted", "tag": "83a60571-08e5-4d6e-8582-5ec7c0304ec1"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:02 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] Creating event network-vif-plugged:83a60571-08e5-4d6e-8582-5ec7c0304ec1 for instance 33b4d519-a2df-4278-afbc-4ce7637b04ab on user Apr 13 19:03:02 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] Creating event network-vif-deleted:83a60571-08e5-4d6e-8582-5ec7c0304ec1 for instance 33b4d519-a2df-4278-afbc-4ce7637b04ab on user Apr 13 19:03:02 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030351 Apr 13 19:03:02 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 108/318] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:11 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-96acc22a-43a1-4800-9010-0f56fe018ce6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:11 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-96acc22a-43a1-4800-9010-0f56fe018ce6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:11 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:11 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-96acc22a-43a1-4800-9010-0f56fe018ce6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-96acc22a-43a1-4800-9010-0f56fe018ce6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-96acc22a-43a1-4800-9010-0f56fe018ce6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-96acc22a-43a1-4800-9010-0f56fe018ce6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-96acc22a-43a1-4800-9010-0f56fe018ce6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-96acc22a-43a1-4800-9010-0f56fe018ce6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:11 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-96acc22a-43a1-4800-9010-0f56fe018ce6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:03:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-96acc22a-43a1-4800-9010-0f56fe018ce6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 200 len: 1641 microversion: 2.1 time: 0.158489 Apr 13 19:03:11 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 107/319] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:03:11 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 1641 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:03:15 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:15 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:15 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-287c76fd-5ed7-4d98-9d7a-49441c3ca274 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:15 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-287c76fd-5ed7-4d98-9d7a-49441c3ca274 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-287c76fd-5ed7-4d98-9d7a-49441c3ca274 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-287c76fd-5ed7-4d98-9d7a-49441c3ca274 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-287c76fd-5ed7-4d98-9d7a-49441c3ca274 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-287c76fd-5ed7-4d98-9d7a-49441c3ca274 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-287c76fd-5ed7-4d98-9d7a-49441c3ca274 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-287c76fd-5ed7-4d98-9d7a-49441c3ca274 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-287c76fd-5ed7-4d98-9d7a-49441c3ca274 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055992 Apr 13 19:03:15 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 105/320] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 19:03:15 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:03:15 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:15 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:15 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:15 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:15 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:03:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f" status: 204 len: 0 microversion: 2.20 time: 0.116741 Apr 13 19:03:15 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 109/321] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:03:15 2023] DELETE /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 19:03:15 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-763d5ae9-7a22-4b49-a146-79a91b509c4e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:15 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-763d5ae9-7a22-4b49-a146-79a91b509c4e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-763d5ae9-7a22-4b49-a146-79a91b509c4e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-763d5ae9-7a22-4b49-a146-79a91b509c4e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-763d5ae9-7a22-4b49-a146-79a91b509c4e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-763d5ae9-7a22-4b49-a146-79a91b509c4e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-763d5ae9-7a22-4b49-a146-79a91b509c4e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-763d5ae9-7a22-4b49-a146-79a91b509c4e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:16 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-763d5ae9-7a22-4b49-a146-79a91b509c4e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:03:16 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-763d5ae9-7a22-4b49-a146-79a91b509c4e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:03:16 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-763d5ae9-7a22-4b49-a146-79a91b509c4e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:03:16 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-763d5ae9-7a22-4b49-a146-79a91b509c4e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f" status: 200 len: 1711 microversion: 2.20 time: 0.152973 Apr 13 19:03:16 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 108/322] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:03:15 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f => generated 1711 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:03:16 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-1dbde542-2408-4370-8249-e70bb0b66db9 req-9b1ae551-5946-47bf-a8ea-e195b7b1a0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "name": "network-vif-unplugged", "status": "completed", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1dbde542-2408-4370-8249-e70bb0b66db9 req-9b1ae551-5946-47bf-a8ea-e195b7b1a0de service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1dbde542-2408-4370-8249-e70bb0b66db9 req-9b1ae551-5946-47bf-a8ea-e195b7b1a0de service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1dbde542-2408-4370-8249-e70bb0b66db9 req-9b1ae551-5946-47bf-a8ea-e195b7b1a0de service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-1dbde542-2408-4370-8249-e70bb0b66db9 req-9b1ae551-5946-47bf-a8ea-e195b7b1a0de service nova] Creating event network-vif-unplugged:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 19:03:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-1dbde542-2408-4370-8249-e70bb0b66db9 req-9b1ae551-5946-47bf-a8ea-e195b7b1a0de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030452 Apr 13 19:03:16 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 106/323] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:16 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-862fc62b-dca9-4660-911a-391af5959dba tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:16 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-862fc62b-dca9-4660-911a-391af5959dba tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-862fc62b-dca9-4660-911a-391af5959dba tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-862fc62b-dca9-4660-911a-391af5959dba tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-862fc62b-dca9-4660-911a-391af5959dba tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-862fc62b-dca9-4660-911a-391af5959dba tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-862fc62b-dca9-4660-911a-391af5959dba tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-862fc62b-dca9-4660-911a-391af5959dba tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:17 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-862fc62b-dca9-4660-911a-391af5959dba tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7f76b4b7fb4651b3bce0e72f8a4de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1308cc4c5734de9a9fd83688c8da796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:03:17 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-862fc62b-dca9-4660-911a-391af5959dba tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a" status: 200 len: 1494 microversion: 2.1 time: 0.222962 Apr 13 19:03:17 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 110/324] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:03:16 2023] GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a => generated 1494 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:03:18 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "name": "network-vif-plugged", "status": "completed", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}, {"server_uuid": "ca1b4132-15bd-4d4e-8d0c-d074824c888f", "name": "network-vif-deleted", "tag": "5a439b7e-d075-4d9e-9673-523b5aa356fd"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:18 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] Creating event network-vif-plugged:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 19:03:18 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] Creating event network-vif-deleted:5a439b7e-d075-4d9e-9673-523b5aa356fd for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f on user Apr 13 19:03:18 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033651 Apr 13 19:03:18 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 109/325] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:34 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:34 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=8 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:34 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-9006ff53-ee33-4ceb-a396-cfe193e22127 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-9006ff53-ee33-4ceb-a396-cfe193e22127 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9006ff53-ee33-4ceb-a396-cfe193e22127 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9006ff53-ee33-4ceb-a396-cfe193e22127 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9006ff53-ee33-4ceb-a396-cfe193e22127 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9006ff53-ee33-4ceb-a396-cfe193e22127 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9006ff53-ee33-4ceb-a396-cfe193e22127 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9006ff53-ee33-4ceb-a396-cfe193e22127 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:34 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-9006ff53-ee33-4ceb-a396-cfe193e22127 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] HTTP exception thrown: Instance 106da0b9-c823-4f26-874c-53f8ad235e61 could not be found. Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-9006ff53-ee33-4ceb-a396-cfe193e22127 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Request method failure captured: Apr 13 19:03:34 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61 HTTP/1.1 Apr 13 19:03:34 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:03:34 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:03:34 user devstack@n-api.service[61587]: Connection: close Apr 13 19:03:34 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:03:34 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:03:34 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:03:34 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:03:34 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBsQ1tqhEyNzJ6vrT13lin_rpFKqO8ZSBvUyRhOrmleEMRge0bdK1lCxFcUXLVOYcGEisGkhDYg0v_LCjtunFR8U6Pg29pzsJftLM3PptF3YMkZiHpchTbnBB8E8nIifR6qXdSchj4l_VQwE2vTTvBMoneW1InKd4Le336LMZvxFMo Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Project-Id: 0d708f05aa7c454bbf94931b6b5593bf Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Project-Name: tempest-VolumesAdminNegativeTest-947401316 Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d708f05aa7c454bbf94931b6b5593bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d708f05aa7c454bbf94931b6b5593bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d708f05aa7c454bbf94931b6b5593bf"}]}] Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Tenant: tempest-VolumesAdminNegativeTest-947401316 Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Tenant-Id: 0d708f05aa7c454bbf94931b6b5593bf Apr 13 19:03:34 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-947401316 Apr 13 19:03:34 user devstack@n-api.service[61587]: X-User: tempest-VolumesAdminNegativeTest-947401316-project-member Apr 13 19:03:34 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:03:34 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:03:34 user devstack@n-api.service[61587]: X-User-Id: 3e1ffe2f879f4c049b6c28d3a9623d14 Apr 13 19:03:34 user devstack@n-api.service[61587]: X-User-Name: tempest-VolumesAdminNegativeTest-947401316-project-member Apr 13 19:03:34 user devstack@n-api.service[61587]: method: > Apr 13 19:03:34 user devstack@n-api.service[61587]: exception: Instance 106da0b9-c823-4f26-874c-53f8ad235e61 could not be found. Apr 13 19:03:34 user devstack@n-api.service[61587]: action_args: {'id': '106da0b9-c823-4f26-874c-53f8ad235e61'} Apr 13 19:03:34 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 106da0b9-c823-4f26-874c-53f8ad235e61 could not be found. Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 106da0b9-c823-4f26-874c-53f8ad235e61 could not be found. Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 106da0b9-c823-4f26-874c-53f8ad235e61 could not be found. Apr 13 19:03:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-9006ff53-ee33-4ceb-a396-cfe193e22127 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Returning 404 to user: Instance 106da0b9-c823-4f26-874c-53f8ad235e61 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:03:34 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-9006ff53-ee33-4ceb-a396-cfe193e22127 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61" status: 404 len: 111 microversion: 2.1 time: 0.036353 Apr 13 19:03:34 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 111/326] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:03:34 2023] GET /compute/v2.1/servers/106da0b9-c823-4f26-874c-53f8ad235e61 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:03:34 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:34 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=14 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:03:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-8ad58afd-fef1-4653-abd4-cca06c93b6b0 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Calling method '.version_select at 0x7efe33f5fbe0>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:34 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'services' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:03:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-8ad58afd-fef1-4653-abd4-cca06c93b6b0 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099795213" status: 202 len: 0 microversion: 2.1 time: 0.029192 Apr 13 19:03:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 110/327] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 19:03:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099795213 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:03:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments/09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9" status: 202 len: 0 microversion: 2.1 time: 0.179404 Apr 13 19:03:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 107/328] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:03:34 2023] DELETE /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments/09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-cd51f671-edca-4508-a65e-dd2d59ef415f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-cd51f671-edca-4508-a65e-dd2d59ef415f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-cd51f671-edca-4508-a65e-dd2d59ef415f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-cd51f671-edca-4508-a65e-dd2d59ef415f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-cd51f671-edca-4508-a65e-dd2d59ef415f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-cd51f671-edca-4508-a65e-dd2d59ef415f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-cd51f671-edca-4508-a65e-dd2d59ef415f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-cd51f671-edca-4508-a65e-dd2d59ef415f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:34 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-cd51f671-edca-4508-a65e-dd2d59ef415f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054044 Apr 13 19:03:34 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 112/329] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:03:34 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:37 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-9577a031-8276-422a-973c-2bc6ed0a5314 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:37 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-9577a031-8276-422a-973c-2bc6ed0a5314 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9577a031-8276-422a-973c-2bc6ed0a5314 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9577a031-8276-422a-973c-2bc6ed0a5314 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9577a031-8276-422a-973c-2bc6ed0a5314 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9577a031-8276-422a-973c-2bc6ed0a5314 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9577a031-8276-422a-973c-2bc6ed0a5314 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9577a031-8276-422a-973c-2bc6ed0a5314 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:38 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-9577a031-8276-422a-973c-2bc6ed0a5314 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.421017 Apr 13 19:03:38 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 111/330] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 19:03:37 2023] GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-interface => generated 282 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 19:03:38 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "tag": "b5d1f04b-5691-4b8b-a52c-d54bdb160292"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:39 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] Creating event network-changed:b5d1f04b-5691-4b8b-a52c-d54bdb160292 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:03:39 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036357 Apr 13 19:03:39 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 108/331] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:39 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-dcab5630-433e-4d7a-8b83-9e0f3851c768 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:39 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-dcab5630-433e-4d7a-8b83-9e0f3851c768 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-dcab5630-433e-4d7a-8b83-9e0f3851c768 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-dcab5630-433e-4d7a-8b83-9e0f3851c768 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-dcab5630-433e-4d7a-8b83-9e0f3851c768 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-dcab5630-433e-4d7a-8b83-9e0f3851c768 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-dcab5630-433e-4d7a-8b83-9e0f3851c768 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-dcab5630-433e-4d7a-8b83-9e0f3851c768 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:39 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-dcab5630-433e-4d7a-8b83-9e0f3851c768 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:03:39 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-dcab5630-433e-4d7a-8b83-9e0f3851c768 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:03:39 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-dcab5630-433e-4d7a-8b83-9e0f3851c768 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:03:39 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-dcab5630-433e-4d7a-8b83-9e0f3851c768 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e" status: 200 len: 1625 microversion: 2.49 time: 0.448407 Apr 13 19:03:39 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 113/332] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:03:39 2023] GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e => generated 1625 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:03:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "d13e7a17-c450-4282-94dd-97197029d1ea", "tag": "nic-tag"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:39 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:41 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "tag": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] Creating event network-changed:821936b2-8b8b-4a71-a3cc-d5ec55666ef6 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:03:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030914 Apr 13 19:03:41 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 109/333] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-21f35d43-e6a0-448b-91f0-729ec568add4 req-5b489638-afda-4ba8-887b-3f6691ca5ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "name": "network-vif-plugged", "status": "completed", "tag": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-21f35d43-e6a0-448b-91f0-729ec568add4 req-5b489638-afda-4ba8-887b-3f6691ca5ccb service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-21f35d43-e6a0-448b-91f0-729ec568add4 req-5b489638-afda-4ba8-887b-3f6691ca5ccb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-21f35d43-e6a0-448b-91f0-729ec568add4 req-5b489638-afda-4ba8-887b-3f6691ca5ccb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-21f35d43-e6a0-448b-91f0-729ec568add4 req-5b489638-afda-4ba8-887b-3f6691ca5ccb service nova] Creating event network-vif-plugged:821936b2-8b8b-4a71-a3cc-d5ec55666ef6 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:03:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-21f35d43-e6a0-448b-91f0-729ec568add4 req-5b489638-afda-4ba8-887b-3f6691ca5ccb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030904 Apr 13 19:03:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 114/334] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:42 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "POST /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-interface" status: 200 len: 282 microversion: 2.49 time: 3.050465 Apr 13 19:03:42 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 112/335] 10.0.0.210 () {66 vars in 1414 bytes} [Thu Apr 13 19:03:39 2023] POST /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-interface => generated 282 bytes in 3052 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 19:03:42 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "031127c5-d900-49a1-8792-ed5b834a387c", "tag": "volume-tag"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:42 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:42 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "POST /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.320305 Apr 13 19:03:42 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 110/336] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 19:03:42 2023] POST /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 19:03:44 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-57988d52-293f-4d89-810c-2ca277ae1530 req-a7946c5d-f447-4c86-bbe1-34abf0774fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "name": "network-vif-plugged", "status": "completed", "tag": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-57988d52-293f-4d89-810c-2ca277ae1530 req-a7946c5d-f447-4c86-bbe1-34abf0774fe5 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-57988d52-293f-4d89-810c-2ca277ae1530 req-a7946c5d-f447-4c86-bbe1-34abf0774fe5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-57988d52-293f-4d89-810c-2ca277ae1530 req-a7946c5d-f447-4c86-bbe1-34abf0774fe5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:44 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-57988d52-293f-4d89-810c-2ca277ae1530 req-a7946c5d-f447-4c86-bbe1-34abf0774fe5 service nova] Creating event network-vif-plugged:821936b2-8b8b-4a71-a3cc-d5ec55666ef6 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:03:44 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-57988d52-293f-4d89-810c-2ca277ae1530 req-a7946c5d-f447-4c86-bbe1-34abf0774fe5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029844 Apr 13 19:03:44 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 115/337] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f48ac5c7-a344-4b23-8a66-3e7a7e2eb394 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f48ac5c7-a344-4b23-8a66-3e7a7e2eb394 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f48ac5c7-a344-4b23-8a66-3e7a7e2eb394 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f48ac5c7-a344-4b23-8a66-3e7a7e2eb394 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f48ac5c7-a344-4b23-8a66-3e7a7e2eb394 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f48ac5c7-a344-4b23-8a66-3e7a7e2eb394 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f48ac5c7-a344-4b23-8a66-3e7a7e2eb394 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f48ac5c7-a344-4b23-8a66-3e7a7e2eb394 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:50 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-f48ac5c7-a344-4b23-8a66-3e7a7e2eb394 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] HTTP exception thrown: Instance 33b4d519-a2df-4278-afbc-4ce7637b04ab could not be found. Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f48ac5c7-a344-4b23-8a66-3e7a7e2eb394 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Request method failure captured: Apr 13 19:03:50 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/33b4d519-a2df-4278-afbc-4ce7637b04ab HTTP/1.1 Apr 13 19:03:50 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:03:50 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:03:50 user devstack@n-api.service[61589]: Connection: close Apr 13 19:03:50 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:03:50 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:03:50 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:03:50 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:03:50 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFFu4X1aetcq3q19s4tJUfBfjduupaGpljLLStl5H_bLTo6txffEj3UfabeB7v6_Ux6qW-5P8bir2O1dyf2unZmND0xUfyKAOOcmX5epopsW4xJWAnmt_vIAInk3cYK5eKejSt6RCRCadRVWjXz6Xh67Oi17EzpbzDlk-MsJzzAQFm8 Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Project-Id: 94f74f6b4f68416ebdb496adc62a48ed Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Project-Name: tempest-VolumesActionsTest-1911230974 Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94f74f6b4f68416ebdb496adc62a48ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94f74f6b4f68416ebdb496adc62a48ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94f74f6b4f68416ebdb496adc62a48ed"}]}] Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Tenant: tempest-VolumesActionsTest-1911230974 Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Tenant-Id: 94f74f6b4f68416ebdb496adc62a48ed Apr 13 19:03:50 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-VolumesActionsTest-1911230974 Apr 13 19:03:50 user devstack@n-api.service[61589]: X-User: tempest-VolumesActionsTest-1911230974-project-member Apr 13 19:03:50 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:03:50 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:03:50 user devstack@n-api.service[61589]: X-User-Id: d1b0d9cad8c64a8ea80420d5d8efe16f Apr 13 19:03:50 user devstack@n-api.service[61589]: X-User-Name: tempest-VolumesActionsTest-1911230974-project-member Apr 13 19:03:50 user devstack@n-api.service[61589]: method: > Apr 13 19:03:50 user devstack@n-api.service[61589]: exception: Instance 33b4d519-a2df-4278-afbc-4ce7637b04ab could not be found. Apr 13 19:03:50 user devstack@n-api.service[61589]: action_args: {'id': '33b4d519-a2df-4278-afbc-4ce7637b04ab'} Apr 13 19:03:50 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b4d519-a2df-4278-afbc-4ce7637b04ab could not be found. Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b4d519-a2df-4278-afbc-4ce7637b04ab could not be found. Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b4d519-a2df-4278-afbc-4ce7637b04ab could not be found. Apr 13 19:03:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f48ac5c7-a344-4b23-8a66-3e7a7e2eb394 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Returning 404 to user: Instance 33b4d519-a2df-4278-afbc-4ce7637b04ab could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:03:50 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f48ac5c7-a344-4b23-8a66-3e7a7e2eb394 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33b4d519-a2df-4278-afbc-4ce7637b04ab" status: 404 len: 111 microversion: 2.1 time: 0.032781 Apr 13 19:03:50 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 111/338] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:03:50 2023] GET /compute/v2.1/servers/33b4d519-a2df-4278-afbc-4ce7637b04ab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-644483843", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG nova.network.neutron [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] validate_networks() for [('f17efc87-567e-4354-9c6b-86094fabd53c', None, None, None, None, None)] {{(pid=61588) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting quotas for project 42fbd7089a7e4ba8b2597fca0d8e84c8. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting quotas for user 3bebf61a7401492692f9c60adde178f7 and project 42fbd7089a7e4ba8b2597fca0d8e84c8. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Going to run 1 instances... {{(pid=61588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:03:50 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:03:50 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.709839 Apr 13 19:03:50 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 113/339] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:03:50 2023] POST /compute/v2.1/servers => generated 381 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:03:50 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-cca5b0fb-24bc-40a7-a7da-458fff15db8f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:50 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-cca5b0fb-24bc-40a7-a7da-458fff15db8f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:50 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-cca5b0fb-24bc-40a7-a7da-458fff15db8f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:03:50 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-cca5b0fb-24bc-40a7-a7da-458fff15db8f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f" status: 200 len: 1215 microversion: 2.1 time: 0.085575 Apr 13 19:03:50 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 116/340] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:03:50 2023] GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1333783847", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG nova.network.neutron [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] validate_networks() for [('f17efc87-567e-4354-9c6b-86094fabd53c', None, None, None, None, None)] {{(pid=61588) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:03:51 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lazy-loading 'services' on Instance uuid 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:03:51 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-volume_attachments/031127c5-d900-49a1-8792-ed5b834a387c" status: 202 len: 0 microversion: 2.49 time: 0.197819 Apr 13 19:03:51 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 112/341] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 19:03:50 2023] DELETE /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-volume_attachments/031127c5-d900-49a1-8792-ed5b834a387c => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting quotas for project 42fbd7089a7e4ba8b2597fca0d8e84c8. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting quotas for user 3bebf61a7401492692f9c60adde178f7 and project 42fbd7089a7e4ba8b2597fca0d8e84c8. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Going to run 1 instances... {{(pid=61588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:03:51 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:03:51 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.568660 Apr 13 19:03:51 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 114/342] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:03:51 2023] POST /compute/v2.1/servers => generated 381 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:03:51 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1325c976-9d3f-473a-ba03-1a5142d90075 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:51 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-1325c976-9d3f-473a-ba03-1a5142d90075 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:51 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-1325c976-9d3f-473a-ba03-1a5142d90075 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:03:51 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-1325c976-9d3f-473a-ba03-1a5142d90075 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df" status: 200 len: 1216 microversion: 2.1 time: 0.062455 Apr 13 19:03:51 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 117/343] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:03:51 2023] GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df => generated 1216 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:03:53 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:53 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:53 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-interface/821936b2-8b8b-4a71-a3cc-d5ec55666ef6" status: 202 len: 0 microversion: 2.49 time: 0.050359 Apr 13 19:03:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:53 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 113/344] 10.0.0.210 () {64 vars in 1507 bytes} [Thu Apr 13 19:03:53 2023] DELETE /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-interface/821936b2-8b8b-4a71-a3cc-d5ec55666ef6 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 13 19:03:53 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] Creating event network-changed:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:03:53 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041868 Apr 13 19:03:53 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 115/345] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:53 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ff2ade33-29de-498a-b20f-fc2d05d70a98 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:03:53 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-ff2ade33-29de-498a-b20f-fc2d05d70a98 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:03:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ff2ade33-29de-498a-b20f-fc2d05d70a98 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ff2ade33-29de-498a-b20f-fc2d05d70a98 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ff2ade33-29de-498a-b20f-fc2d05d70a98 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ff2ade33-29de-498a-b20f-fc2d05d70a98 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ff2ade33-29de-498a-b20f-fc2d05d70a98 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ff2ade33-29de-498a-b20f-fc2d05d70a98 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-ff2ade33-29de-498a-b20f-fc2d05d70a98 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-instance-actions/req-bca39486-e292-49f5-b357-1573cbf8b5d9" status: 200 len: 474 microversion: 2.49 time: 0.291049 Apr 13 19:03:53 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 118/346] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 19:03:53 2023] GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-instance-actions/req-bca39486-e292-49f5-b357-1573cbf8b5d9 => generated 474 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 19:03:54 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-cddacf14-b58e-42d7-96ef-ae665ad906a6 req-af5b0cca-ce60-41f9-8051-268f8effc7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "name": "network-vif-unplugged", "status": "completed", "tag": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cddacf14-b58e-42d7-96ef-ae665ad906a6 req-af5b0cca-ce60-41f9-8051-268f8effc7c2 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cddacf14-b58e-42d7-96ef-ae665ad906a6 req-af5b0cca-ce60-41f9-8051-268f8effc7c2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cddacf14-b58e-42d7-96ef-ae665ad906a6 req-af5b0cca-ce60-41f9-8051-268f8effc7c2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:54 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-cddacf14-b58e-42d7-96ef-ae665ad906a6 req-af5b0cca-ce60-41f9-8051-268f8effc7c2 service nova] Creating event network-vif-unplugged:821936b2-8b8b-4a71-a3cc-d5ec55666ef6 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:03:54 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-cddacf14-b58e-42d7-96ef-ae665ad906a6 req-af5b0cca-ce60-41f9-8051-268f8effc7c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060953 Apr 13 19:03:54 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 114/347] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:54 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d7b86a-c723-4255-827e-2f6a641239df", "tag": "3de4b459-2a9f-4570-80b1-dce61f40a377"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:54 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] Creating event network-changed:3de4b459-2a9f-4570-80b1-dce61f40a377 for instance 59d7b86a-c723-4255-827e-2f6a641239df on user Apr 13 19:03:54 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048573 Apr 13 19:03:54 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 116/348] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:56 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-976ee81d-fe10-4fe7-abff-c6c75938545c req-1d82eae2-548d-43af-86ca-08e81f8262fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-plugged", "status": "completed", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-976ee81d-fe10-4fe7-abff-c6c75938545c req-1d82eae2-548d-43af-86ca-08e81f8262fe service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-976ee81d-fe10-4fe7-abff-c6c75938545c req-1d82eae2-548d-43af-86ca-08e81f8262fe service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-976ee81d-fe10-4fe7-abff-c6c75938545c req-1d82eae2-548d-43af-86ca-08e81f8262fe service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-976ee81d-fe10-4fe7-abff-c6c75938545c req-1d82eae2-548d-43af-86ca-08e81f8262fe service nova] Creating event network-vif-plugged:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:03:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-976ee81d-fe10-4fe7-abff-c6c75938545c req-1d82eae2-548d-43af-86ca-08e81f8262fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048347 Apr 13 19:03:56 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 119/349] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:56 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "name": "network-vif-plugged", "status": "completed", "tag": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6"}, {"server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "name": "network-vif-deleted", "tag": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] Creating event network-vif-plugged:821936b2-8b8b-4a71-a3cc-d5ec55666ef6 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:03:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] Creating event network-vif-deleted:821936b2-8b8b-4a71-a3cc-d5ec55666ef6 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:03:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049700 Apr 13 19:03:56 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 115/350] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:58 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-0e584f18-92bc-4cb1-9312-65d12f9b9030 req-6387226e-738e-4fa3-884e-951efcfcd576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-plugged", "status": "completed", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0e584f18-92bc-4cb1-9312-65d12f9b9030 req-6387226e-738e-4fa3-884e-951efcfcd576 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0e584f18-92bc-4cb1-9312-65d12f9b9030 req-6387226e-738e-4fa3-884e-951efcfcd576 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0e584f18-92bc-4cb1-9312-65d12f9b9030 req-6387226e-738e-4fa3-884e-951efcfcd576 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:58 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0e584f18-92bc-4cb1-9312-65d12f9b9030 req-6387226e-738e-4fa3-884e-951efcfcd576 service nova] Creating event network-vif-plugged:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:03:58 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-0e584f18-92bc-4cb1-9312-65d12f9b9030 req-6387226e-738e-4fa3-884e-951efcfcd576 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031369 Apr 13 19:03:58 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 117/351] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:03:58 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d7b86a-c723-4255-827e-2f6a641239df", "name": "network-vif-plugged", "status": "completed", "tag": "3de4b459-2a9f-4570-80b1-dce61f40a377"}, {"server_uuid": "59d7b86a-c723-4255-827e-2f6a641239df", "name": "network-vif-plugged", "status": "completed", "tag": "3de4b459-2a9f-4570-80b1-dce61f40a377"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:03:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:03:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:03:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:03:58 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] Creating event network-vif-plugged:3de4b459-2a9f-4570-80b1-dce61f40a377 for instance 59d7b86a-c723-4255-827e-2f6a641239df on user Apr 13 19:03:58 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] Creating event network-vif-plugged:3de4b459-2a9f-4570-80b1-dce61f40a377 for instance 59d7b86a-c723-4255-827e-2f6a641239df on user Apr 13 19:03:58 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030909 Apr 13 19:03:58 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 120/352] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:03:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:06 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ce82ffd8-89a3-4f80-a509-219a6121bec6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:06 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ce82ffd8-89a3-4f80-a509-219a6121bec6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:06 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=19 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ce82ffd8-89a3-4f80-a509-219a6121bec6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ce82ffd8-89a3-4f80-a509-219a6121bec6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ce82ffd8-89a3-4f80-a509-219a6121bec6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ce82ffd8-89a3-4f80-a509-219a6121bec6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ce82ffd8-89a3-4f80-a509-219a6121bec6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ce82ffd8-89a3-4f80-a509-219a6121bec6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:06 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:06 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-ce82ffd8-89a3-4f80-a509-219a6121bec6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] HTTP exception thrown: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:04:06 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ce82ffd8-89a3-4f80-a509-219a6121bec6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Request method failure captured: Apr 13 19:04:06 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f HTTP/1.1 Apr 13 19:04:06 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:04:06 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:04:06 user devstack@n-api.service[61589]: Connection: close Apr 13 19:04:06 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:04:06 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:04:06 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:04:06 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:04:06 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBklJWjujPp7_H2HyeXYwZV1Iyrbv0W_02hOgzZjJJa8Le36FOcl4nlEQ0OEaAHNMIkFNxhBLn_fFHQ41HweFRR9363GgB8bfDFQ6_bzBzTrNMLnQfkW2o5hfOos_zLtVE2MNRXKdsHe_6rHCrIpZt9oegglM1s6bbnyShXflzrk8A Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Project-Id: faabdcc8e61c452ab3b934b1c9501e68 Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faabdcc8e61c452ab3b934b1c9501e68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/faabdcc8e61c452ab3b934b1c9501e68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faabdcc8e61c452ab3b934b1c9501e68"}]}] Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Tenant-Id: faabdcc8e61c452ab3b934b1c9501e68 Apr 13 19:04:06 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:04:06 user devstack@n-api.service[61589]: X-User: tempest-AttachVolumeShelveTestJSON-1546308967-project-member Apr 13 19:04:06 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:04:06 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:04:06 user devstack@n-api.service[61589]: X-User-Id: ee6c76c605d54b4f84e0596b27087f0b Apr 13 19:04:06 user devstack@n-api.service[61589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1546308967-project-member Apr 13 19:04:06 user devstack@n-api.service[61589]: method: > Apr 13 19:04:06 user devstack@n-api.service[61589]: exception: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:04:06 user devstack@n-api.service[61589]: action_args: {'id': 'ca1b4132-15bd-4d4e-8d0c-d074824c888f'} Apr 13 19:04:06 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:04:06 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:04:06 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ce82ffd8-89a3-4f80-a509-219a6121bec6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Returning 404 to user: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:04:06 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ce82ffd8-89a3-4f80-a509-219a6121bec6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f" status: 404 len: 111 microversion: 2.20 time: 0.048813 Apr 13 19:04:06 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 116/353] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:04:06 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:04:06 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0035fcdd-733c-4e8c-a96d-03b151611cfe tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '.version_select at 0x7efe383d3130>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:06 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:06 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=12 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:06 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:06 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-0035fcdd-733c-4e8c-a96d-03b151611cfe tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219895845" status: 204 len: 0 microversion: 2.20 time: 0.028999 Apr 13 19:04:06 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 118/354] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 19:04:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219895845 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 19:04:06 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-41e55ca5-e2b3-4160-9612-b62fc71fb068 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Action: 'create', calling method: .version_select at 0x7efe382e4e50>, body: {"keypair": {"name": "tempest-keypair-1280930280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZe8WHxNPt+OEFTfKSkzy8wZuScIjzJeyBVbA3Z02RJMRIdLJty1zSrwoxsbVtyU7kpmUkL2gYS28J8h+WxdhP9nXELXUDvHj2w4B2VNtkzNPMfJnxeWpbUzlRv0BK2Kg=="}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:06 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:06 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=25 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:06 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-41e55ca5-e2b3-4160-9612-b62fc71fb068 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting quotas for project faabdcc8e61c452ab3b934b1c9501e68. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:04:06 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-41e55ca5-e2b3-4160-9612-b62fc71fb068 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting quotas for user ee6c76c605d54b4f84e0596b27087f0b and project faabdcc8e61c452ab3b934b1c9501e68. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:04:06 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-41e55ca5-e2b3-4160-9612-b62fc71fb068 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051130 Apr 13 19:04:06 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 121/355] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 19:04:06 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 19:04:08 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1141253084", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab"}], "security_groups": [{"name": "tempest-securitygroup--1465880488"}], "key_name": "tempest-keypair-1280930280", "user_data": "}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] validate_networks() for [('9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab', None, None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting quotas for project faabdcc8e61c452ab3b934b1c9501e68. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting quotas for user ee6c76c605d54b4f84e0596b27087f0b and project faabdcc8e61c452ab3b934b1c9501e68. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:04:09 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:04:09 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.828562 Apr 13 19:04:09 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 117/356] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 19:04:08 2023] POST /compute/v2.1/servers => generated 400 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 19:04:09 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-5fd37c86-1fec-4e44-8f2e-d2e15606983e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:09 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-5fd37c86-1fec-4e44-8f2e-d2e15606983e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:09 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-5fd37c86-1fec-4e44-8f2e-d2e15606983e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:09 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-5fd37c86-1fec-4e44-8f2e-d2e15606983e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:09 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-5fd37c86-1fec-4e44-8f2e-d2e15606983e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-5fd37c86-1fec-4e44-8f2e-d2e15606983e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae" status: 200 len: 1276 microversion: 2.20 time: 0.079871 Apr 13 19:04:09 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 119/357] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:04:09 2023] GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae => generated 1276 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:04:11 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=30 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:11 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:12 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Going to try to start instance {{(pid=61587) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 19:04:12 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/action" status: 202 len: 0 microversion: 2.1 time: 0.080283 Apr 13 19:04:12 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 122/358] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:04:11 2023] POST /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:04:12 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f08a0c82-123d-4588-94d6-2425b959bbfe tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:12 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f08a0c82-123d-4588-94d6-2425b959bbfe tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f08a0c82-123d-4588-94d6-2425b959bbfe tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f08a0c82-123d-4588-94d6-2425b959bbfe tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f08a0c82-123d-4588-94d6-2425b959bbfe tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f08a0c82-123d-4588-94d6-2425b959bbfe tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f08a0c82-123d-4588-94d6-2425b959bbfe tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f08a0c82-123d-4588-94d6-2425b959bbfe tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:12 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-f08a0c82-123d-4588-94d6-2425b959bbfe tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f08a0c82-123d-4588-94d6-2425b959bbfe tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 200 len: 1650 microversion: 2.1 time: 0.171185 Apr 13 19:04:12 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 118/359] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:04:12 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 1650 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 19:04:12 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:12 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] Creating event network-changed:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:04:12 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048261 Apr 13 19:04:12 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 120/360] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:04:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:14 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-dda9d4e3-b8a3-49ce-8239-d2ec5b5baa26 req-a4c081b7-3d7b-43b6-a7c7-951cf26c69c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-plugged", "status": "completed", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dda9d4e3-b8a3-49ce-8239-d2ec5b5baa26 req-a4c081b7-3d7b-43b6-a7c7-951cf26c69c4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dda9d4e3-b8a3-49ce-8239-d2ec5b5baa26 req-a4c081b7-3d7b-43b6-a7c7-951cf26c69c4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dda9d4e3-b8a3-49ce-8239-d2ec5b5baa26 req-a4c081b7-3d7b-43b6-a7c7-951cf26c69c4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:14 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-dda9d4e3-b8a3-49ce-8239-d2ec5b5baa26 req-a4c081b7-3d7b-43b6-a7c7-951cf26c69c4 service nova] Creating event network-vif-plugged:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:04:14 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-dda9d4e3-b8a3-49ce-8239-d2ec5b5baa26 req-a4c081b7-3d7b-43b6-a7c7-951cf26c69c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038555 Apr 13 19:04:14 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 123/361] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:04:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:16 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-a963b631-7cdb-4da2-b80f-fbed5c6f6f28 req-504f66f6-4bb2-462c-baf9-393349b7410c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-plugged", "status": "completed", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a963b631-7cdb-4da2-b80f-fbed5c6f6f28 req-504f66f6-4bb2-462c-baf9-393349b7410c service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a963b631-7cdb-4da2-b80f-fbed5c6f6f28 req-504f66f6-4bb2-462c-baf9-393349b7410c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a963b631-7cdb-4da2-b80f-fbed5c6f6f28 req-504f66f6-4bb2-462c-baf9-393349b7410c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-a963b631-7cdb-4da2-b80f-fbed5c6f6f28 req-504f66f6-4bb2-462c-baf9-393349b7410c service nova] Creating event network-vif-plugged:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 19:04:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-a963b631-7cdb-4da2-b80f-fbed5c6f6f28 req-504f66f6-4bb2-462c-baf9-393349b7410c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041206 Apr 13 19:04:16 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 119/362] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:04:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:16 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-6bf761b6-4d0e-4ab6-8622-d6500bf1bcfe req-53c4ad14-08d4-4250-85a8-61ab6c4d01b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-plugged", "status": "completed", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-6bf761b6-4d0e-4ab6-8622-d6500bf1bcfe req-53c4ad14-08d4-4250-85a8-61ab6c4d01b7 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-6bf761b6-4d0e-4ab6-8622-d6500bf1bcfe req-53c4ad14-08d4-4250-85a8-61ab6c4d01b7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-6bf761b6-4d0e-4ab6-8622-d6500bf1bcfe req-53c4ad14-08d4-4250-85a8-61ab6c4d01b7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:16 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-6bf761b6-4d0e-4ab6-8622-d6500bf1bcfe req-53c4ad14-08d4-4250-85a8-61ab6c4d01b7 service nova] Creating event network-vif-plugged:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:04:16 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-6bf761b6-4d0e-4ab6-8622-d6500bf1bcfe req-53c4ad14-08d4-4250-85a8-61ab6c4d01b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028788 Apr 13 19:04:16 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 121/363] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:04:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:18 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:18 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-99047305-c63c-4607-94d0-f0cb193e114e req-d7a86f3c-54f4-4a3f-971d-43db1b8870fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-plugged", "status": "completed", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-99047305-c63c-4607-94d0-f0cb193e114e req-d7a86f3c-54f4-4a3f-971d-43db1b8870fb service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-99047305-c63c-4607-94d0-f0cb193e114e req-d7a86f3c-54f4-4a3f-971d-43db1b8870fb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-99047305-c63c-4607-94d0-f0cb193e114e req-d7a86f3c-54f4-4a3f-971d-43db1b8870fb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:18 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-99047305-c63c-4607-94d0-f0cb193e114e req-d7a86f3c-54f4-4a3f-971d-43db1b8870fb service nova] Creating event network-vif-plugged:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 19:04:18 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-99047305-c63c-4607-94d0-f0cb193e114e req-d7a86f3c-54f4-4a3f-971d-43db1b8870fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044195 Apr 13 19:04:18 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 124/364] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:04:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:18 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-a9b1e5c9-f44a-4505-99fc-327f254ae793 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-596670338", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "destination_type": "local"}, {"source_type": "volume", "uuid": "677e78b3-a59a-419d-bc48-a9ee314bc9ad", "destination_type": "invalid"}], "networks": [{"uuid": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f"}]}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:18 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-a9b1e5c9-f44a-4505-99fc-327f254ae793 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Request method failure captured: Apr 13 19:04:18 user devstack@n-api.service[61589]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 19:04:18 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:04:18 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:04:18 user devstack@n-api.service[61589]: Connection: close Apr 13 19:04:18 user devstack@n-api.service[61589]: Content-Length: 493 Apr 13 19:04:18 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:04:18 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:04:18 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:04:18 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBotx2ZM_9G1ZGBLCrl4LdPuMuif2otYt97YnqmlwhHzUsK6HVbp_6Twn9eY83XPXsPwtTDlDzIlMAP_ZMUr1gwRn72lFZ01UPE7Lb3StrwzhEltbae1cO6LsZeUGsWFJGxIgFKBnSkheTVbPlpbDVQ6u6s0l1v4R20quh3bFT9M8M Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Project-Id: a1308cc4c5734de9a9fd83688c8da796 Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Project-Name: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1308cc4c5734de9a9fd83688c8da796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a1308cc4c5734de9a9fd83688c8da796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1308cc4c5734de9a9fd83688c8da796"}]}] Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Tenant: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Tenant-Id: a1308cc4c5734de9a9fd83688c8da796 Apr 13 19:04:18 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:04:18 user devstack@n-api.service[61589]: X-User: tempest-ServersNegativeTestJSON-1876599222-project-member Apr 13 19:04:18 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:04:18 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:04:18 user devstack@n-api.service[61589]: X-User-Id: 3e7f76b4b7fb4651b3bce0e72f8a4de6 Apr 13 19:04:18 user devstack@n-api.service[61589]: X-User-Name: tempest-ServersNegativeTestJSON-1876599222-project-member Apr 13 19:04:18 user devstack@n-api.service[61589]: Apr 13 19:04:18 user devstack@n-api.service[61589]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-596670338", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "destination_type": "local"}, {"source_type": "volume", "uuid": "677e78b3-a59a-419d-bc48-a9ee314bc9ad", "destination_type": "invalid"}], "networks": [{"uuid": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f"}]}} Apr 13 19:04:18 user devstack@n-api.service[61589]: method: > Apr 13 19:04:18 user devstack@n-api.service[61589]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 19:04:18 user devstack@n-api.service[61589]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-596670338', 'imageRef': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '677e78b3-a59a-419d-bc48-a9ee314bc9ad', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'ae895ef0-18d7-4f77-bcc6-bcb3dd22026f'}]}}} Apr 13 19:04:18 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise error Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi 'invalid' Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 19:04:18 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:04:18 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-a9b1e5c9-f44a-4505-99fc-327f254ae793 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:04:18 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-a9b1e5c9-f44a-4505-99fc-327f254ae793 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.012519 Apr 13 19:04:18 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 120/365] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:04:18 2023] POST /compute/v2.1/servers => generated 155 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 13 19:04:18 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ce0cd579-348c-4634-b4b3-1102c963743d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:18 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ce0cd579-348c-4634-b4b3-1102c963743d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ce0cd579-348c-4634-b4b3-1102c963743d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ce0cd579-348c-4634-b4b3-1102c963743d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ce0cd579-348c-4634-b4b3-1102c963743d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ce0cd579-348c-4634-b4b3-1102c963743d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ce0cd579-348c-4634-b4b3-1102c963743d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ce0cd579-348c-4634-b4b3-1102c963743d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:18 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-ce0cd579-348c-4634-b4b3-1102c963743d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7f76b4b7fb4651b3bce0e72f8a4de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1308cc4c5734de9a9fd83688c8da796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:18 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-ce0cd579-348c-4634-b4b3-1102c963743d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a" status: 200 len: 1494 microversion: 2.1 time: 0.203367 Apr 13 19:04:18 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 122/366] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:04:18 2023] GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a => generated 1494 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:04:24 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-481f97e8-ef2f-46c3-a4da-5db984754c74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:24 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-481f97e8-ef2f-46c3-a4da-5db984754c74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-481f97e8-ef2f-46c3-a4da-5db984754c74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-481f97e8-ef2f-46c3-a4da-5db984754c74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-481f97e8-ef2f-46c3-a4da-5db984754c74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-481f97e8-ef2f-46c3-a4da-5db984754c74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-481f97e8-ef2f-46c3-a4da-5db984754c74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-481f97e8-ef2f-46c3-a4da-5db984754c74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:24 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-481f97e8-ef2f-46c3-a4da-5db984754c74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057247 Apr 13 19:04:24 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 125/367] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:04:24 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:04:24 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:24 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:24 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-2bd23653-0d81-47d1-a09d-48231c70d552 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:24 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-2bd23653-0d81-47d1-a09d-48231c70d552 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2bd23653-0d81-47d1-a09d-48231c70d552 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2bd23653-0d81-47d1-a09d-48231c70d552 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2bd23653-0d81-47d1-a09d-48231c70d552 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2bd23653-0d81-47d1-a09d-48231c70d552 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2bd23653-0d81-47d1-a09d-48231c70d552 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2bd23653-0d81-47d1-a09d-48231c70d552 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:24 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-2bd23653-0d81-47d1-a09d-48231c70d552 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-2bd23653-0d81-47d1-a09d-48231c70d552 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1674 microversion: 2.1 time: 0.160510 Apr 13 19:04:24 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 121/368] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:04:24 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 19:04:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-85ce1254-dee8-47f0-aa1a-395c8de15b35 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:24 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-85ce1254-dee8-47f0-aa1a-395c8de15b35 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-85ce1254-dee8-47f0-aa1a-395c8de15b35 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-85ce1254-dee8-47f0-aa1a-395c8de15b35 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-85ce1254-dee8-47f0-aa1a-395c8de15b35 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-85ce1254-dee8-47f0-aa1a-395c8de15b35 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-85ce1254-dee8-47f0-aa1a-395c8de15b35 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-85ce1254-dee8-47f0-aa1a-395c8de15b35 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:25 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-85ce1254-dee8-47f0-aa1a-395c8de15b35 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-85ce1254-dee8-47f0-aa1a-395c8de15b35 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1674 microversion: 2.1 time: 0.162246 Apr 13 19:04:25 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 123/369] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:04:24 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:04:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a3ccc52e-5d10-4fc2-b523-7de63b12f021 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:25 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-a3ccc52e-5d10-4fc2-b523-7de63b12f021 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a3ccc52e-5d10-4fc2-b523-7de63b12f021 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a3ccc52e-5d10-4fc2-b523-7de63b12f021 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a3ccc52e-5d10-4fc2-b523-7de63b12f021 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a3ccc52e-5d10-4fc2-b523-7de63b12f021 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a3ccc52e-5d10-4fc2-b523-7de63b12f021 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a3ccc52e-5d10-4fc2-b523-7de63b12f021 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:25 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-a3ccc52e-5d10-4fc2-b523-7de63b12f021 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a3ccc52e-5d10-4fc2-b523-7de63b12f021 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1674 microversion: 2.1 time: 0.287334 Apr 13 19:04:25 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 126/370] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:04:25 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1674 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:04:37 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:37 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=17 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:37 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9a675a6e-4964-4c53-aa42-eb051a5296a4 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Action: 'create', calling method: .version_select at 0x7efe33fb11b0>, body: {"keypair": {"name": "tempest-TestStampPattern-550784019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHlW3C03mbx8npnGQJlBa+Z8VKTTGNO9FQPBpbP73f2RM1T737WN8fLrDdW9N64l6RsTGIQydByfuY41AlVN9GkKHEdIxhoJ63MlO2Jt2MVwCLy66RUUbGjTxXc1hX0iw=="}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:37 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-9a675a6e-4964-4c53-aa42-eb051a5296a4 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Getting quotas for project 3347c59f4ca945399a4323e689460d12. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:04:37 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-9a675a6e-4964-4c53-aa42-eb051a5296a4 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Getting quotas for user cb7bcc69770a4859904f1b66cece61e3 and project 3347c59f4ca945399a4323e689460d12. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:04:37 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-9a675a6e-4964-4c53-aa42-eb051a5296a4 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.268841 Apr 13 19:04:37 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 122/371] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:04:37 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-115859800", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "key_name": "tempest-TestStampPattern-550784019", "security_groups": [{"name": "tempest-secgroup-smoke-1896646470"}], "networks": [{"uuid": "a5157bcb-9174-46af-b786-e4b159907e6e"}]}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=16 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG nova.network.neutron [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] validate_networks() for [('a5157bcb-9174-46af-b786-e4b159907e6e', None, None, None, None, None)] {{(pid=61588) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Flavor limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Image limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Flavor pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Image pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Getting quotas for project 3347c59f4ca945399a4323e689460d12. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Getting quotas for user cb7bcc69770a4859904f1b66cece61e3 and project 3347c59f4ca945399a4323e689460d12. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Going to run 1 instances... {{(pid=61588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:04:40 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:04:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.524690 Apr 13 19:04:40 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 124/372] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:04:40 2023] POST /compute/v2.1/servers => generated 404 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:04:40 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:40 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:40 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-71eea70e-4035-405e-b06d-c75f4b0a2dc8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:40 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-71eea70e-4035-405e-b06d-c75f4b0a2dc8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:40 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-71eea70e-4035-405e-b06d-c75f4b0a2dc8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7bcc69770a4859904f1b66cece61e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347c59f4ca945399a4323e689460d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-71eea70e-4035-405e-b06d-c75f4b0a2dc8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d" status: 200 len: 1235 microversion: 2.1 time: 0.107122 Apr 13 19:04:40 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 127/373] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:04:40 2023] GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d => generated 1235 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:04:41 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-59ce5fc0-1ccc-4085-bfd5-02ab6ea42054 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:41 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-59ce5fc0-1ccc-4085-bfd5-02ab6ea42054 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59ce5fc0-1ccc-4085-bfd5-02ab6ea42054 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59ce5fc0-1ccc-4085-bfd5-02ab6ea42054 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59ce5fc0-1ccc-4085-bfd5-02ab6ea42054 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59ce5fc0-1ccc-4085-bfd5-02ab6ea42054 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59ce5fc0-1ccc-4085-bfd5-02ab6ea42054 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59ce5fc0-1ccc-4085-bfd5-02ab6ea42054 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:41 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-59ce5fc0-1ccc-4085-bfd5-02ab6ea42054 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-59ce5fc0-1ccc-4085-bfd5-02ab6ea42054 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df" status: 200 len: 1504 microversion: 2.1 time: 0.149823 Apr 13 19:04:41 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 123/374] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:04:41 2023] GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:04:42 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb3fb753-ff8d-4dac-ab70-f940233bf25d", "tag": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] Creating event network-changed:cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 for instance cb3fb753-ff8d-4dac-ab70-f940233bf25d on user Apr 13 19:04:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033117 Apr 13 19:04:42 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 125/375] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:04:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:43 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-d41426c5-a8c1-4ab0-86af-df521f4a408a tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:43 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-d41426c5-a8c1-4ab0-86af-df521f4a408a tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d41426c5-a8c1-4ab0-86af-df521f4a408a tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d41426c5-a8c1-4ab0-86af-df521f4a408a tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d41426c5-a8c1-4ab0-86af-df521f4a408a tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d41426c5-a8c1-4ab0-86af-df521f4a408a tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d41426c5-a8c1-4ab0-86af-df521f4a408a tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d41426c5-a8c1-4ab0-86af-df521f4a408a tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-d41426c5-a8c1-4ab0-86af-df521f4a408a tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-instance-actions/req-bca39486-e292-49f5-b357-1573cbf8b5d9" status: 200 len: 503 microversion: 2.49 time: 0.047203 Apr 13 19:04:43 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 128/376] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 19:04:43 2023] GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-instance-actions/req-bca39486-e292-49f5-b357-1573cbf8b5d9 => generated 503 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 19:04:43 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-88f01c28-1b83-4c65-b01c-3ffcb6a307c9 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:43 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-88f01c28-1b83-4c65-b01c-3ffcb6a307c9 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-88f01c28-1b83-4c65-b01c-3ffcb6a307c9 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-88f01c28-1b83-4c65-b01c-3ffcb6a307c9 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-88f01c28-1b83-4c65-b01c-3ffcb6a307c9 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-88f01c28-1b83-4c65-b01c-3ffcb6a307c9 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-88f01c28-1b83-4c65-b01c-3ffcb6a307c9 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-88f01c28-1b83-4c65-b01c-3ffcb6a307c9 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:43 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-88f01c28-1b83-4c65-b01c-3ffcb6a307c9 tempest-TaggedAttachmentsTest-648731967 tempest-TaggedAttachmentsTest-648731967-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-instance-actions/req-bca39486-e292-49f5-b357-1573cbf8b5d9" status: 200 len: 503 microversion: 2.49 time: 0.091410 Apr 13 19:04:43 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 124/377] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 19:04:43 2023] GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-instance-actions/req-bca39486-e292-49f5-b357-1573cbf8b5d9 => generated 503 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 19:04:44 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d265da48-4f92-449a-87bf-0fa3814eb1e4 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:44 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-d265da48-4f92-449a-87bf-0fa3814eb1e4 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d265da48-4f92-449a-87bf-0fa3814eb1e4 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d265da48-4f92-449a-87bf-0fa3814eb1e4 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d265da48-4f92-449a-87bf-0fa3814eb1e4 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d265da48-4f92-449a-87bf-0fa3814eb1e4 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d265da48-4f92-449a-87bf-0fa3814eb1e4 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d265da48-4f92-449a-87bf-0fa3814eb1e4 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-d265da48-4f92-449a-87bf-0fa3814eb1e4 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.042646 Apr 13 19:04:44 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 126/378] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 19:04:43 2023] GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:04:44 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e" status: 204 len: 0 microversion: 2.49 time: 0.102615 Apr 13 19:04:44 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 129/379] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:04:44 2023] DELETE /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 19:04:44 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-29a97940-c7b4-4a28-b447-4b5b6cd2e384 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:44 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-29a97940-c7b4-4a28-b447-4b5b6cd2e384 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-29a97940-c7b4-4a28-b447-4b5b6cd2e384 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-29a97940-c7b4-4a28-b447-4b5b6cd2e384 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-29a97940-c7b4-4a28-b447-4b5b6cd2e384 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-29a97940-c7b4-4a28-b447-4b5b6cd2e384 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-29a97940-c7b4-4a28-b447-4b5b6cd2e384 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-29a97940-c7b4-4a28-b447-4b5b6cd2e384 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:44 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-29a97940-c7b4-4a28-b447-4b5b6cd2e384 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:44 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-29a97940-c7b4-4a28-b447-4b5b6cd2e384 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:44 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-29a97940-c7b4-4a28-b447-4b5b6cd2e384 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:44 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-29a97940-c7b4-4a28-b447-4b5b6cd2e384 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e" status: 200 len: 1750 microversion: 2.49 time: 0.210808 Apr 13 19:04:44 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 125/380] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:04:44 2023] GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e => generated 1750 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:04:44 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-1b3d0b16-6a5b-46ae-b850-7c1c1b749cf1 req-401c3bcb-3696-4ba4-a813-4963690dc829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "name": "network-vif-unplugged", "status": "completed", "tag": "b5d1f04b-5691-4b8b-a52c-d54bdb160292"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-1b3d0b16-6a5b-46ae-b850-7c1c1b749cf1 req-401c3bcb-3696-4ba4-a813-4963690dc829 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-1b3d0b16-6a5b-46ae-b850-7c1c1b749cf1 req-401c3bcb-3696-4ba4-a813-4963690dc829 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-1b3d0b16-6a5b-46ae-b850-7c1c1b749cf1 req-401c3bcb-3696-4ba4-a813-4963690dc829 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-1b3d0b16-6a5b-46ae-b850-7c1c1b749cf1 req-401c3bcb-3696-4ba4-a813-4963690dc829 service nova] Creating event network-vif-unplugged:b5d1f04b-5691-4b8b-a52c-d54bdb160292 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:04:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-1b3d0b16-6a5b-46ae-b850-7c1c1b749cf1 req-401c3bcb-3696-4ba4-a813-4963690dc829 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.026632 Apr 13 19:04:44 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 127/381] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:04:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-f609bb65-79d0-4edc-88f8-89b780b33c94 req-d5a0f54a-b771-4c69-9a48-96bf2fff25bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3fb753-ff8d-4dac-ab70-f940233bf25d", "name": "network-vif-plugged", "status": "completed", "tag": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-f609bb65-79d0-4edc-88f8-89b780b33c94 req-d5a0f54a-b771-4c69-9a48-96bf2fff25bc service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-f609bb65-79d0-4edc-88f8-89b780b33c94 req-d5a0f54a-b771-4c69-9a48-96bf2fff25bc service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-f609bb65-79d0-4edc-88f8-89b780b33c94 req-d5a0f54a-b771-4c69-9a48-96bf2fff25bc service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:44 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-f609bb65-79d0-4edc-88f8-89b780b33c94 req-d5a0f54a-b771-4c69-9a48-96bf2fff25bc service nova] Creating event network-vif-plugged:cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 for instance cb3fb753-ff8d-4dac-ab70-f940233bf25d on user Apr 13 19:04:44 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-f609bb65-79d0-4edc-88f8-89b780b33c94 req-d5a0f54a-b771-4c69-9a48-96bf2fff25bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032993 Apr 13 19:04:44 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 130/382] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:04:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-6902632c-60ca-4cb6-9351-6306cb9f5531 req-f6c9b0ad-bee0-42ba-8de3-90e650c3f4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "name": "network-vif-deleted", "tag": "b5d1f04b-5691-4b8b-a52c-d54bdb160292"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6902632c-60ca-4cb6-9351-6306cb9f5531 req-f6c9b0ad-bee0-42ba-8de3-90e650c3f4f4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6902632c-60ca-4cb6-9351-6306cb9f5531 req-f6c9b0ad-bee0-42ba-8de3-90e650c3f4f4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6902632c-60ca-4cb6-9351-6306cb9f5531 req-f6c9b0ad-bee0-42ba-8de3-90e650c3f4f4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:46 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-6902632c-60ca-4cb6-9351-6306cb9f5531 req-f6c9b0ad-bee0-42ba-8de3-90e650c3f4f4 service nova] Creating event network-vif-deleted:b5d1f04b-5691-4b8b-a52c-d54bdb160292 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:04:46 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-6902632c-60ca-4cb6-9351-6306cb9f5531 req-f6c9b0ad-bee0-42ba-8de3-90e650c3f4f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032175 Apr 13 19:04:46 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 126/383] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:04:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:46 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-7fbb7bc2-e5bb-47e9-a85b-6c922a8efd89 req-b92e8c61-1719-4ebc-8952-04c24e18b974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20edda40-d5dd-4c56-9c5d-023cfd330c8e", "name": "network-vif-plugged", "status": "completed", "tag": "b5d1f04b-5691-4b8b-a52c-d54bdb160292"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7fbb7bc2-e5bb-47e9-a85b-6c922a8efd89 req-b92e8c61-1719-4ebc-8952-04c24e18b974 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7fbb7bc2-e5bb-47e9-a85b-6c922a8efd89 req-b92e8c61-1719-4ebc-8952-04c24e18b974 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7fbb7bc2-e5bb-47e9-a85b-6c922a8efd89 req-b92e8c61-1719-4ebc-8952-04c24e18b974 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:46 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-7fbb7bc2-e5bb-47e9-a85b-6c922a8efd89 req-b92e8c61-1719-4ebc-8952-04c24e18b974 service nova] Creating event network-vif-plugged:b5d1f04b-5691-4b8b-a52c-d54bdb160292 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e on user Apr 13 19:04:46 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-7fbb7bc2-e5bb-47e9-a85b-6c922a8efd89 req-b92e8c61-1719-4ebc-8952-04c24e18b974 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030654 Apr 13 19:04:46 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 128/384] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:04:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:46 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-34219c24-66b1-4760-859f-9bc08ab45b5e req-7794ae4d-eff1-4a47-89a1-0e84c712a493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3fb753-ff8d-4dac-ab70-f940233bf25d", "name": "network-vif-plugged", "status": "completed", "tag": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:04:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-34219c24-66b1-4760-859f-9bc08ab45b5e req-7794ae4d-eff1-4a47-89a1-0e84c712a493 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-34219c24-66b1-4760-859f-9bc08ab45b5e req-7794ae4d-eff1-4a47-89a1-0e84c712a493 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-34219c24-66b1-4760-859f-9bc08ab45b5e req-7794ae4d-eff1-4a47-89a1-0e84c712a493 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:46 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-34219c24-66b1-4760-859f-9bc08ab45b5e req-7794ae4d-eff1-4a47-89a1-0e84c712a493 service nova] Creating event network-vif-plugged:cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 for instance cb3fb753-ff8d-4dac-ab70-f940233bf25d on user Apr 13 19:04:46 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-34219c24-66b1-4760-859f-9bc08ab45b5e req-7794ae4d-eff1-4a47-89a1-0e84c712a493 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028094 Apr 13 19:04:46 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 131/385] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:04:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=22 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-4f434315-5682-47be-9603-180f11d990af tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-4f434315-5682-47be-9603-180f11d990af tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4f434315-5682-47be-9603-180f11d990af tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4f434315-5682-47be-9603-180f11d990af tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4f434315-5682-47be-9603-180f11d990af tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4f434315-5682-47be-9603-180f11d990af tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4f434315-5682-47be-9603-180f11d990af tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4f434315-5682-47be-9603-180f11d990af tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-4f434315-5682-47be-9603-180f11d990af tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-4f434315-5682-47be-9603-180f11d990af tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:59 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-4f434315-5682-47be-9603-180f11d990af tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:04:59 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-4f434315-5682-47be-9603-180f11d990af tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae" status: 200 len: 1588 microversion: 2.20 time: 0.158145 Apr 13 19:04:59 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 127/386] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:04:59 2023] GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae => generated 1588 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=14 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-8cd3aa18-caa3-4d21-9fa5-a36f1a930cfb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-8cd3aa18-caa3-4d21-9fa5-a36f1a930cfb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8cd3aa18-caa3-4d21-9fa5-a36f1a930cfb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8cd3aa18-caa3-4d21-9fa5-a36f1a930cfb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8cd3aa18-caa3-4d21-9fa5-a36f1a930cfb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8cd3aa18-caa3-4d21-9fa5-a36f1a930cfb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8cd3aa18-caa3-4d21-9fa5-a36f1a930cfb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8cd3aa18-caa3-4d21-9fa5-a36f1a930cfb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:02 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-8cd3aa18-caa3-4d21-9fa5-a36f1a930cfb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:05:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-8cd3aa18-caa3-4d21-9fa5-a36f1a930cfb tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 200 len: 1654 microversion: 2.1 time: 0.148072 Apr 13 19:05:02 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 129/387] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:05:02 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 1654 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e313a422-2355-4c42-925e-ef39c3854e12 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e313a422-2355-4c42-925e-ef39c3854e12 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e313a422-2355-4c42-925e-ef39c3854e12 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e313a422-2355-4c42-925e-ef39c3854e12 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e313a422-2355-4c42-925e-ef39c3854e12 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e313a422-2355-4c42-925e-ef39c3854e12 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e313a422-2355-4c42-925e-ef39c3854e12 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e313a422-2355-4c42-925e-ef39c3854e12 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:23 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-e313a422-2355-4c42-925e-ef39c3854e12 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] HTTP exception thrown: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e313a422-2355-4c42-925e-ef39c3854e12 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Request method failure captured: Apr 13 19:05:23 user devstack@n-api.service[61587]: request: DELETE /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb HTTP/1.1 Apr 13 19:05:23 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:05:23 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:05:23 user devstack@n-api.service[61587]: Connection: close Apr 13 19:05:23 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:05:23 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:05:23 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:05:23 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:05:23 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBotx2ZM_9G1ZGBLCrl4LdPuMuif2otYt97YnqmlwhHzUsK6HVbp_6Twn9eY83XPXsPwtTDlDzIlMAP_ZMUr1gwRn72lFZ01UPE7Lb3StrwzhEltbae1cO6LsZeUGsWFJGxIgFKBnSkheTVbPlpbDVQ6u6s0l1v4R20quh3bFT9M8M Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Project-Id: a1308cc4c5734de9a9fd83688c8da796 Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Project-Name: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1308cc4c5734de9a9fd83688c8da796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a1308cc4c5734de9a9fd83688c8da796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1308cc4c5734de9a9fd83688c8da796"}]}] Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Tenant: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Tenant-Id: a1308cc4c5734de9a9fd83688c8da796 Apr 13 19:05:23 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:05:23 user devstack@n-api.service[61587]: X-User: tempest-ServersNegativeTestJSON-1876599222-project-member Apr 13 19:05:23 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:05:23 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:05:23 user devstack@n-api.service[61587]: X-User-Id: 3e7f76b4b7fb4651b3bce0e72f8a4de6 Apr 13 19:05:23 user devstack@n-api.service[61587]: X-User-Name: tempest-ServersNegativeTestJSON-1876599222-project-member Apr 13 19:05:23 user devstack@n-api.service[61587]: method: > Apr 13 19:05:23 user devstack@n-api.service[61587]: exception: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:05:23 user devstack@n-api.service[61587]: action_args: {'id': '0d7ba594-cc5f-470e-9cd3-7ff90f341aeb'} Apr 13 19:05:23 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:05:23 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e313a422-2355-4c42-925e-ef39c3854e12 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Returning 404 to user: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:05:23 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e313a422-2355-4c42-925e-ef39c3854e12 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" status: 404 len: 111 microversion: 2.1 time: 0.043814 Apr 13 19:05:23 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 132/388] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:05:23 2023] DELETE /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-22f402e6-6d75-4a9f-bed0-9d435d4eb504 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-22f402e6-6d75-4a9f-bed0-9d435d4eb504 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-22f402e6-6d75-4a9f-bed0-9d435d4eb504 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-22f402e6-6d75-4a9f-bed0-9d435d4eb504 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-22f402e6-6d75-4a9f-bed0-9d435d4eb504 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-22f402e6-6d75-4a9f-bed0-9d435d4eb504 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-22f402e6-6d75-4a9f-bed0-9d435d4eb504 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-22f402e6-6d75-4a9f-bed0-9d435d4eb504 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-22f402e6-6d75-4a9f-bed0-9d435d4eb504 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] HTTP exception thrown: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-22f402e6-6d75-4a9f-bed0-9d435d4eb504 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Request method failure captured: Apr 13 19:05:23 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb HTTP/1.1 Apr 13 19:05:23 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:05:23 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:05:23 user devstack@n-api.service[61589]: Connection: close Apr 13 19:05:23 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:05:23 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:05:23 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:05:23 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:05:23 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBotx2ZM_9G1ZGBLCrl4LdPuMuif2otYt97YnqmlwhHzUsK6HVbp_6Twn9eY83XPXsPwtTDlDzIlMAP_ZMUr1gwRn72lFZ01UPE7Lb3StrwzhEltbae1cO6LsZeUGsWFJGxIgFKBnSkheTVbPlpbDVQ6u6s0l1v4R20quh3bFT9M8M Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Project-Id: a1308cc4c5734de9a9fd83688c8da796 Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Project-Name: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1308cc4c5734de9a9fd83688c8da796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a1308cc4c5734de9a9fd83688c8da796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1308cc4c5734de9a9fd83688c8da796"}]}] Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Tenant: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Tenant-Id: a1308cc4c5734de9a9fd83688c8da796 Apr 13 19:05:23 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:05:23 user devstack@n-api.service[61589]: X-User: tempest-ServersNegativeTestJSON-1876599222-project-member Apr 13 19:05:23 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:05:23 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:05:23 user devstack@n-api.service[61589]: X-User-Id: 3e7f76b4b7fb4651b3bce0e72f8a4de6 Apr 13 19:05:23 user devstack@n-api.service[61589]: X-User-Name: tempest-ServersNegativeTestJSON-1876599222-project-member Apr 13 19:05:23 user devstack@n-api.service[61589]: method: > Apr 13 19:05:23 user devstack@n-api.service[61589]: exception: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:05:23 user devstack@n-api.service[61589]: action_args: {'id': '0d7ba594-cc5f-470e-9cd3-7ff90f341aeb'} Apr 13 19:05:23 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. Apr 13 19:05:23 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-22f402e6-6d75-4a9f-bed0-9d435d4eb504 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Returning 404 to user: Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:05:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-22f402e6-6d75-4a9f-bed0-9d435d4eb504 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" status: 404 len: 111 microversion: 2.1 time: 0.035560 Apr 13 19:05:23 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 128/389] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:05:23 2023] GET /compute/v2.1/servers/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:05:23 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:23 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:23 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:05:23 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:05:23 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:23 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:23 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:23 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:23 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:23 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:23 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:05:23 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a" status: 204 len: 0 microversion: 2.1 time: 0.116805 Apr 13 19:05:23 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 130/390] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:05:23 2023] DELETE /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-91bb9021-e1d2-4104-b11e-2a7d89c8243d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-91bb9021-e1d2-4104-b11e-2a7d89c8243d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91bb9021-e1d2-4104-b11e-2a7d89c8243d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91bb9021-e1d2-4104-b11e-2a7d89c8243d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91bb9021-e1d2-4104-b11e-2a7d89c8243d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91bb9021-e1d2-4104-b11e-2a7d89c8243d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91bb9021-e1d2-4104-b11e-2a7d89c8243d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91bb9021-e1d2-4104-b11e-2a7d89c8243d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:23 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-91bb9021-e1d2-4104-b11e-2a7d89c8243d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7f76b4b7fb4651b3bce0e72f8a4de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1308cc4c5734de9a9fd83688c8da796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:05:23 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-91bb9021-e1d2-4104-b11e-2a7d89c8243d tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a" status: 200 len: 1500 microversion: 2.1 time: 0.188992 Apr 13 19:05:23 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 133/391] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:05:23 2023] GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a => generated 1500 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-394f29d9-519f-422f-9d88-7d1b5681846b req-29e166cd-270e-4448-a5e3-c52211df11bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17525a6-e377-4b33-85cd-88a7aaf4569a", "name": "network-vif-unplugged", "status": "completed", "tag": "209c6974-cf54-4917-a9dc-2608f9eb10d9"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-394f29d9-519f-422f-9d88-7d1b5681846b req-29e166cd-270e-4448-a5e3-c52211df11bb service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-394f29d9-519f-422f-9d88-7d1b5681846b req-29e166cd-270e-4448-a5e3-c52211df11bb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-394f29d9-519f-422f-9d88-7d1b5681846b req-29e166cd-270e-4448-a5e3-c52211df11bb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-394f29d9-519f-422f-9d88-7d1b5681846b req-29e166cd-270e-4448-a5e3-c52211df11bb service nova] Creating event network-vif-unplugged:209c6974-cf54-4917-a9dc-2608f9eb10d9 for instance f17525a6-e377-4b33-85cd-88a7aaf4569a on user Apr 13 19:05:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-394f29d9-519f-422f-9d88-7d1b5681846b req-29e166cd-270e-4448-a5e3-c52211df11bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033827 Apr 13 19:05:23 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 129/392] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:05:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:05:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-10783268-c3f4-4579-8e31-89509e270bc8 req-0a3a44d3-2c19-49f2-b831-a4406dcb5b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17525a6-e377-4b33-85cd-88a7aaf4569a", "name": "network-vif-deleted", "tag": "209c6974-cf54-4917-a9dc-2608f9eb10d9"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-10783268-c3f4-4579-8e31-89509e270bc8 req-0a3a44d3-2c19-49f2-b831-a4406dcb5b0a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-10783268-c3f4-4579-8e31-89509e270bc8 req-0a3a44d3-2c19-49f2-b831-a4406dcb5b0a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-10783268-c3f4-4579-8e31-89509e270bc8 req-0a3a44d3-2c19-49f2-b831-a4406dcb5b0a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-10783268-c3f4-4579-8e31-89509e270bc8 req-0a3a44d3-2c19-49f2-b831-a4406dcb5b0a service nova] Creating event network-vif-deleted:209c6974-cf54-4917-a9dc-2608f9eb10d9 for instance f17525a6-e377-4b33-85cd-88a7aaf4569a on user Apr 13 19:05:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-10783268-c3f4-4579-8e31-89509e270bc8 req-0a3a44d3-2c19-49f2-b831-a4406dcb5b0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033350 Apr 13 19:05:24 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 131/393] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:05:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:05:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-8e1f9a05-5e0f-415b-beec-b3b5756b65fc req-48ffa71a-9898-4555-b00b-d50f1da702ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17525a6-e377-4b33-85cd-88a7aaf4569a", "name": "network-vif-plugged", "status": "completed", "tag": "209c6974-cf54-4917-a9dc-2608f9eb10d9"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8e1f9a05-5e0f-415b-beec-b3b5756b65fc req-48ffa71a-9898-4555-b00b-d50f1da702ce service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8e1f9a05-5e0f-415b-beec-b3b5756b65fc req-48ffa71a-9898-4555-b00b-d50f1da702ce service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8e1f9a05-5e0f-415b-beec-b3b5756b65fc req-48ffa71a-9898-4555-b00b-d50f1da702ce service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-8e1f9a05-5e0f-415b-beec-b3b5756b65fc req-48ffa71a-9898-4555-b00b-d50f1da702ce service nova] Creating event network-vif-plugged:209c6974-cf54-4917-a9dc-2608f9eb10d9 for instance f17525a6-e377-4b33-85cd-88a7aaf4569a on user Apr 13 19:05:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-8e1f9a05-5e0f-415b-beec-b3b5756b65fc req-48ffa71a-9898-4555-b00b-d50f1da702ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029793 Apr 13 19:05:25 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 134/394] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:05:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:05:27 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-cb711ce6-3cb6-4d8c-a7ff-b3385dc557c7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:27 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-cb711ce6-3cb6-4d8c-a7ff-b3385dc557c7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cb711ce6-3cb6-4d8c-a7ff-b3385dc557c7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cb711ce6-3cb6-4d8c-a7ff-b3385dc557c7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cb711ce6-3cb6-4d8c-a7ff-b3385dc557c7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cb711ce6-3cb6-4d8c-a7ff-b3385dc557c7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cb711ce6-3cb6-4d8c-a7ff-b3385dc557c7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cb711ce6-3cb6-4d8c-a7ff-b3385dc557c7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:27 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-cb711ce6-3cb6-4d8c-a7ff-b3385dc557c7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:05:27 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-cb711ce6-3cb6-4d8c-a7ff-b3385dc557c7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1674 microversion: 2.1 time: 0.141006 Apr 13 19:05:27 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 130/395] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:05:27 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1674 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:05:27 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50a307e4-f870-4d27-ba29-f61e22e6a414"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:27 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:27 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:27 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:27 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:27 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:27 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:27 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269117 Apr 13 19:05:28 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 132/396] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:05:27 2023] POST /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:05:30 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-15710ab3-c680-4e3e-8a50-01180adf17d8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:30 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-15710ab3-c680-4e3e-8a50-01180adf17d8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:30 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-15710ab3-c680-4e3e-8a50-01180adf17d8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:30 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-15710ab3-c680-4e3e-8a50-01180adf17d8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:30 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-15710ab3-c680-4e3e-8a50-01180adf17d8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:30 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-15710ab3-c680-4e3e-8a50-01180adf17d8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:30 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-15710ab3-c680-4e3e-8a50-01180adf17d8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:30 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-15710ab3-c680-4e3e-8a50-01180adf17d8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:30 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-15710ab3-c680-4e3e-8a50-01180adf17d8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7bcc69770a4859904f1b66cece61e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347c59f4ca945399a4323e689460d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:05:30 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-15710ab3-c680-4e3e-8a50-01180adf17d8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d" status: 200 len: 1538 microversion: 2.1 time: 0.208346 Apr 13 19:05:30 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 135/397] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:05:30 2023] GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d => generated 1538 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:05:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-836e7911-2805-4492-be63-2fb035ebc350 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:34 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-836e7911-2805-4492-be63-2fb035ebc350 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-836e7911-2805-4492-be63-2fb035ebc350 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-836e7911-2805-4492-be63-2fb035ebc350 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-836e7911-2805-4492-be63-2fb035ebc350 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-836e7911-2805-4492-be63-2fb035ebc350 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-836e7911-2805-4492-be63-2fb035ebc350 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-836e7911-2805-4492-be63-2fb035ebc350 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-836e7911-2805-4492-be63-2fb035ebc350 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] HTTP exception thrown: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-836e7911-2805-4492-be63-2fb035ebc350 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Request method failure captured: Apr 13 19:05:34 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e HTTP/1.1 Apr 13 19:05:34 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:05:34 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:05:34 user devstack@n-api.service[61589]: Connection: close Apr 13 19:05:34 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:05:34 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:05:34 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:05:34 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:05:34 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFGPD6gJevOdm6joeVPQb5yn5G68DmkOfNLOhqknhi6HDcPDCWRxV532mvHAjRqlsFzo7K8usw2t_0YWMDzvdwyfusWs9QyC3DImM3a3O_oDgD2hK4px0xy6ORCqWeURzKCXs5fvKVYm0QTCviJHCw5eetMhHGMmTqfK0vsBEo1FZm0 Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Project-Id: ee3a4f50c893404b94c839e86a55b47c Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Project-Name: tempest-TaggedAttachmentsTest-1514135387 Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee3a4f50c893404b94c839e86a55b47c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ee3a4f50c893404b94c839e86a55b47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee3a4f50c893404b94c839e86a55b47c"}]}] Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Tenant: tempest-TaggedAttachmentsTest-1514135387 Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Tenant-Id: ee3a4f50c893404b94c839e86a55b47c Apr 13 19:05:34 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1514135387 Apr 13 19:05:34 user devstack@n-api.service[61589]: X-User: tempest-TaggedAttachmentsTest-1514135387-project-member Apr 13 19:05:34 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:05:34 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:05:34 user devstack@n-api.service[61589]: X-User-Id: 3ff67e015f5c4480919a0bd503abedc3 Apr 13 19:05:34 user devstack@n-api.service[61589]: X-User-Name: tempest-TaggedAttachmentsTest-1514135387-project-member Apr 13 19:05:34 user devstack@n-api.service[61589]: method: > Apr 13 19:05:34 user devstack@n-api.service[61589]: exception: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:34 user devstack@n-api.service[61589]: action_args: {'id': '20edda40-d5dd-4c56-9c5d-023cfd330c8e'} Apr 13 19:05:34 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:05:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-836e7911-2805-4492-be63-2fb035ebc350 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Returning 404 to user: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:05:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-836e7911-2805-4492-be63-2fb035ebc350 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e" status: 404 len: 111 microversion: 2.49 time: 0.032021 Apr 13 19:05:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 131/398] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:05:34 2023] GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:05:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-1ae3ac28-c44b-4d4f-b56c-7ff082ded454 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '.version_select at 0x7efe38222dd0>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-1ae3ac28-c44b-4d4f-b56c-7ff082ded454 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-883887520" status: 204 len: 0 microversion: 2.49 time: 0.021837 Apr 13 19:05:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 133/399] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 19:05:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-883887520 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Old instance type m1.nano, new instance type m1.micro {{(pid=61587) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for project c162f91cba4b4ecf9de48fbf839da261. Resources: {'cores', 'ram'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for user df209814208d415e9d414d39205aaad6 and project c162f91cba4b4ecf9de48fbf839da261. Resources: {'cores', 'ram'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:05:34 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:05:35 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/action" status: 202 len: 0 microversion: 2.1 time: 0.374600 Apr 13 19:05:35 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 136/400] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:05:34 2023] POST /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:05:35 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-c262a7c1-b475-4671-9522-326473b7f97b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:35 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-c262a7c1-b475-4671-9522-326473b7f97b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c262a7c1-b475-4671-9522-326473b7f97b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c262a7c1-b475-4671-9522-326473b7f97b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c262a7c1-b475-4671-9522-326473b7f97b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c262a7c1-b475-4671-9522-326473b7f97b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c262a7c1-b475-4671-9522-326473b7f97b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c262a7c1-b475-4671-9522-326473b7f97b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:35 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-c262a7c1-b475-4671-9522-326473b7f97b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:05:35 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-c262a7c1-b475-4671-9522-326473b7f97b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1729 microversion: 2.1 time: 0.229248 Apr 13 19:05:35 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 132/401] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:05:35 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:05:36 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-7798fd1b-1470-4f6c-875c-43d90786e9b8 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:36 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-7798fd1b-1470-4f6c-875c-43d90786e9b8 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7798fd1b-1470-4f6c-875c-43d90786e9b8 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7798fd1b-1470-4f6c-875c-43d90786e9b8 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7798fd1b-1470-4f6c-875c-43d90786e9b8 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7798fd1b-1470-4f6c-875c-43d90786e9b8 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7798fd1b-1470-4f6c-875c-43d90786e9b8 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7798fd1b-1470-4f6c-875c-43d90786e9b8 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:36 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-7798fd1b-1470-4f6c-875c-43d90786e9b8 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] HTTP exception thrown: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:36 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-7798fd1b-1470-4f6c-875c-43d90786e9b8 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Request method failure captured: Apr 13 19:05:36 user devstack@n-api.service[61588]: request: DELETE /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e HTTP/1.1 Apr 13 19:05:36 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:05:36 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:05:36 user devstack@n-api.service[61588]: Connection: close Apr 13 19:05:36 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:05:36 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:05:36 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:05:36 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:05:36 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFGPD6gJevOdm6joeVPQb5yn5G68DmkOfNLOhqknhi6HDcPDCWRxV532mvHAjRqlsFzo7K8usw2t_0YWMDzvdwyfusWs9QyC3DImM3a3O_oDgD2hK4px0xy6ORCqWeURzKCXs5fvKVYm0QTCviJHCw5eetMhHGMmTqfK0vsBEo1FZm0 Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Project-Id: ee3a4f50c893404b94c839e86a55b47c Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Project-Name: tempest-TaggedAttachmentsTest-1514135387 Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee3a4f50c893404b94c839e86a55b47c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ee3a4f50c893404b94c839e86a55b47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee3a4f50c893404b94c839e86a55b47c"}]}] Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Tenant: tempest-TaggedAttachmentsTest-1514135387 Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Tenant-Id: ee3a4f50c893404b94c839e86a55b47c Apr 13 19:05:36 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1514135387 Apr 13 19:05:36 user devstack@n-api.service[61588]: X-User: tempest-TaggedAttachmentsTest-1514135387-project-member Apr 13 19:05:36 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:05:36 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:05:36 user devstack@n-api.service[61588]: X-User-Id: 3ff67e015f5c4480919a0bd503abedc3 Apr 13 19:05:36 user devstack@n-api.service[61588]: X-User-Name: tempest-TaggedAttachmentsTest-1514135387-project-member Apr 13 19:05:36 user devstack@n-api.service[61588]: method: > Apr 13 19:05:36 user devstack@n-api.service[61588]: exception: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:36 user devstack@n-api.service[61588]: action_args: {'id': '20edda40-d5dd-4c56-9c5d-023cfd330c8e'} Apr 13 19:05:36 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:36 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:05:36 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-7798fd1b-1470-4f6c-875c-43d90786e9b8 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Returning 404 to user: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:05:36 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-7798fd1b-1470-4f6c-875c-43d90786e9b8 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e" status: 404 len: 111 microversion: 2.49 time: 0.033038 Apr 13 19:05:36 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 134/402] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:05:36 2023] DELETE /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:05:36 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-78a8715e-1459-4fd6-8e45-4e3856cf8479 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:36 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-78a8715e-1459-4fd6-8e45-4e3856cf8479 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:36 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-78a8715e-1459-4fd6-8e45-4e3856cf8479 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:36 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-78a8715e-1459-4fd6-8e45-4e3856cf8479 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:36 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-78a8715e-1459-4fd6-8e45-4e3856cf8479 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:36 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-78a8715e-1459-4fd6-8e45-4e3856cf8479 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:36 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-78a8715e-1459-4fd6-8e45-4e3856cf8479 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:36 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-78a8715e-1459-4fd6-8e45-4e3856cf8479 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:36 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-78a8715e-1459-4fd6-8e45-4e3856cf8479 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] HTTP exception thrown: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:36 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-78a8715e-1459-4fd6-8e45-4e3856cf8479 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Request method failure captured: Apr 13 19:05:36 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e HTTP/1.1 Apr 13 19:05:36 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:05:36 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:05:36 user devstack@n-api.service[61587]: Connection: close Apr 13 19:05:36 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:05:36 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:05:36 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:05:36 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:05:36 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFGPD6gJevOdm6joeVPQb5yn5G68DmkOfNLOhqknhi6HDcPDCWRxV532mvHAjRqlsFzo7K8usw2t_0YWMDzvdwyfusWs9QyC3DImM3a3O_oDgD2hK4px0xy6ORCqWeURzKCXs5fvKVYm0QTCviJHCw5eetMhHGMmTqfK0vsBEo1FZm0 Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Project-Id: ee3a4f50c893404b94c839e86a55b47c Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Project-Name: tempest-TaggedAttachmentsTest-1514135387 Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee3a4f50c893404b94c839e86a55b47c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ee3a4f50c893404b94c839e86a55b47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee3a4f50c893404b94c839e86a55b47c"}]}] Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Tenant: tempest-TaggedAttachmentsTest-1514135387 Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Tenant-Id: ee3a4f50c893404b94c839e86a55b47c Apr 13 19:05:36 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1514135387 Apr 13 19:05:36 user devstack@n-api.service[61587]: X-User: tempest-TaggedAttachmentsTest-1514135387-project-member Apr 13 19:05:36 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:05:36 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:05:36 user devstack@n-api.service[61587]: X-User-Id: 3ff67e015f5c4480919a0bd503abedc3 Apr 13 19:05:36 user devstack@n-api.service[61587]: X-User-Name: tempest-TaggedAttachmentsTest-1514135387-project-member Apr 13 19:05:36 user devstack@n-api.service[61587]: method: > Apr 13 19:05:36 user devstack@n-api.service[61587]: exception: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:36 user devstack@n-api.service[61587]: action_args: {'id': '20edda40-d5dd-4c56-9c5d-023cfd330c8e'} Apr 13 19:05:36 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. Apr 13 19:05:36 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:05:36 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-78a8715e-1459-4fd6-8e45-4e3856cf8479 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Returning 404 to user: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:05:36 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-78a8715e-1459-4fd6-8e45-4e3856cf8479 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e" status: 404 len: 111 microversion: 2.49 time: 0.028321 Apr 13 19:05:36 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 137/403] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:05:36 2023] GET /compute/v2.1/servers/20edda40-d5dd-4c56-9c5d-023cfd330c8e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:05:37 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-unplugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:37 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] Creating event network-vif-unplugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:05:37 user devstack@n-api.service[61589]: DEBUG nova.compute.api [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 19:05:37 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042227 Apr 13 19:05:37 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 133/404] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:05:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:05:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] Creating event network-vif-plugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:05:39 user devstack@n-api.service[61588]: DEBUG nova.compute.api [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 19:05:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043770 Apr 13 19:05:39 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 135/405] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:05:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:05:41 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:41 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:42 user devstack@n-api.service[61587]: DEBUG nova.objects.instance [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'flavor' on Instance uuid 59d7b86a-c723-4255-827e-2f6a641239df {{(pid=61587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:05:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "POST /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df/action" status: 200 len: 32 microversion: 2.1 time: 0.153745 Apr 13 19:05:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 138/406] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:05:41 2023] POST /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:05:42 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-a8216ff4-52f5-46ff-8187-b52bf9978baa tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:05:42 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-a8216ff4-52f5-46ff-8187-b52bf9978baa tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:05:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a8216ff4-52f5-46ff-8187-b52bf9978baa tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a8216ff4-52f5-46ff-8187-b52bf9978baa tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a8216ff4-52f5-46ff-8187-b52bf9978baa tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a8216ff4-52f5-46ff-8187-b52bf9978baa tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a8216ff4-52f5-46ff-8187-b52bf9978baa tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a8216ff4-52f5-46ff-8187-b52bf9978baa tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:42 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-a8216ff4-52f5-46ff-8187-b52bf9978baa tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:05:42 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-a8216ff4-52f5-46ff-8187-b52bf9978baa tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df" status: 200 len: 1510 microversion: 2.1 time: 0.148376 Apr 13 19:05:42 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 134/407] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:05:42 2023] GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 19:05:43 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-96740c2d-66b7-4ba0-8ffe-a168e56925f9 req-7169cf82-5f6c-4e48-b5c3-1418957db6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d7b86a-c723-4255-827e-2f6a641239df", "name": "network-vif-unplugged", "status": "completed", "tag": "3de4b459-2a9f-4570-80b1-dce61f40a377"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-96740c2d-66b7-4ba0-8ffe-a168e56925f9 req-7169cf82-5f6c-4e48-b5c3-1418957db6d3 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-96740c2d-66b7-4ba0-8ffe-a168e56925f9 req-7169cf82-5f6c-4e48-b5c3-1418957db6d3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-96740c2d-66b7-4ba0-8ffe-a168e56925f9 req-7169cf82-5f6c-4e48-b5c3-1418957db6d3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-96740c2d-66b7-4ba0-8ffe-a168e56925f9 req-7169cf82-5f6c-4e48-b5c3-1418957db6d3 service nova] Creating event network-vif-unplugged:3de4b459-2a9f-4570-80b1-dce61f40a377 for instance 59d7b86a-c723-4255-827e-2f6a641239df on user Apr 13 19:05:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-96740c2d-66b7-4ba0-8ffe-a168e56925f9 req-7169cf82-5f6c-4e48-b5c3-1418957db6d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030155 Apr 13 19:05:43 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 136/408] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:05:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:05:45 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:05:45 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-499c50cb-d6f9-4baa-a6df-e1c6110fb9e0 req-e088fe3d-fb8e-4cd8-bb1a-0a37741984a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d7b86a-c723-4255-827e-2f6a641239df", "name": "network-vif-plugged", "status": "completed", "tag": "3de4b459-2a9f-4570-80b1-dce61f40a377"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:45 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-499c50cb-d6f9-4baa-a6df-e1c6110fb9e0 req-e088fe3d-fb8e-4cd8-bb1a-0a37741984a1 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:45 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-499c50cb-d6f9-4baa-a6df-e1c6110fb9e0 req-e088fe3d-fb8e-4cd8-bb1a-0a37741984a1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:45 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-499c50cb-d6f9-4baa-a6df-e1c6110fb9e0 req-e088fe3d-fb8e-4cd8-bb1a-0a37741984a1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:45 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-499c50cb-d6f9-4baa-a6df-e1c6110fb9e0 req-e088fe3d-fb8e-4cd8-bb1a-0a37741984a1 service nova] Creating event network-vif-plugged:3de4b459-2a9f-4570-80b1-dce61f40a377 for instance 59d7b86a-c723-4255-827e-2f6a641239df on user Apr 13 19:05:45 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-499c50cb-d6f9-4baa-a6df-e1c6110fb9e0 req-e088fe3d-fb8e-4cd8-bb1a-0a37741984a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033610 Apr 13 19:05:45 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 139/409] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:05:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:05:47 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d7b86a-c723-4255-827e-2f6a641239df", "name": "network-vif-plugged", "status": "completed", "tag": "3de4b459-2a9f-4570-80b1-dce61f40a377"}, {"server_uuid": "59d7b86a-c723-4255-827e-2f6a641239df", "name": "network-vif-plugged", "status": "completed", "tag": "3de4b459-2a9f-4570-80b1-dce61f40a377"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] Creating event network-vif-plugged:3de4b459-2a9f-4570-80b1-dce61f40a377 for instance 59d7b86a-c723-4255-827e-2f6a641239df on user Apr 13 19:05:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] Creating event network-vif-plugged:3de4b459-2a9f-4570-80b1-dce61f40a377 for instance 59d7b86a-c723-4255-827e-2f6a641239df on user Apr 13 19:05:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036451 Apr 13 19:05:47 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 135/410] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:05:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:05:49 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:49 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] Creating event network-vif-plugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:05:49 user devstack@n-api.service[61588]: DEBUG nova.compute.api [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 19:05:49 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060005 Apr 13 19:05:49 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 137/411] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:05:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:05:51 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:05:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:05:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:05:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:05:51 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] Creating event network-vif-plugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:05:51 user devstack@n-api.service[61587]: DEBUG nova.compute.api [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 19:05:51 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057285 Apr 13 19:05:51 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 140/412] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:05:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:00 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=16 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:00 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=30 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:00 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d56bf310-35c8-49a0-9e68-cd30503d5b7d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:00 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-d56bf310-35c8-49a0-9e68-cd30503d5b7d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:00 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d56bf310-35c8-49a0-9e68-cd30503d5b7d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:00 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d56bf310-35c8-49a0-9e68-cd30503d5b7d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:00 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d56bf310-35c8-49a0-9e68-cd30503d5b7d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:00 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d56bf310-35c8-49a0-9e68-cd30503d5b7d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:00 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d56bf310-35c8-49a0-9e68-cd30503d5b7d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:00 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d56bf310-35c8-49a0-9e68-cd30503d5b7d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:00 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d56bf310-35c8-49a0-9e68-cd30503d5b7d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.107335 Apr 13 19:06:00 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 136/413] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 19:06:00 2023] GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/os-interface => generated 283 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 13 19:06:01 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:01 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:01 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] Creating event network-changed:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:06:01 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035264 Apr 13 19:06:01 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 138/414] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:06:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e2886fdf-639f-4510-bbd6-1548607c29ab tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:01 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e2886fdf-639f-4510-bbd6-1548607c29ab tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:01 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=31 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e2886fdf-639f-4510-bbd6-1548607c29ab tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e2886fdf-639f-4510-bbd6-1548607c29ab tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e2886fdf-639f-4510-bbd6-1548607c29ab tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e2886fdf-639f-4510-bbd6-1548607c29ab tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e2886fdf-639f-4510-bbd6-1548607c29ab tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e2886fdf-639f-4510-bbd6-1548607c29ab tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:01 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e2886fdf-639f-4510-bbd6-1548607c29ab tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/ips" status: 200 len: 110 microversion: 2.20 time: 0.055337 Apr 13 19:06:01 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 141/415] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 19:06:01 2023] GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/ips => generated 110 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-b39dae42-6cfd-4a03-b115-4536e50cd321 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-b39dae42-6cfd-4a03-b115-4536e50cd321 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b39dae42-6cfd-4a03-b115-4536e50cd321 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b39dae42-6cfd-4a03-b115-4536e50cd321 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b39dae42-6cfd-4a03-b115-4536e50cd321 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b39dae42-6cfd-4a03-b115-4536e50cd321 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b39dae42-6cfd-4a03-b115-4536e50cd321 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b39dae42-6cfd-4a03-b115-4536e50cd321 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:02 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-b39dae42-6cfd-4a03-b115-4536e50cd321 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045337 Apr 13 19:06:02 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 137/416] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:06:02 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:06:02 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:02 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:02 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:02 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:06:02 user devstack@n-api.service[61588]: DEBUG nova.objects.instance [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'flavor' on Instance uuid 2c2e4899-d6d5-422c-a4f1-61a8129abdae {{(pid=61588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:06:02 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 204 len: 0 microversion: 2.1 time: 0.122661 Apr 13 19:06:02 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 142/417] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:06:02 2023] DELETE /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-30f1db7b-4952-4d84-aec8-01733bd8d857 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-30f1db7b-4952-4d84-aec8-01733bd8d857 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-30f1db7b-4952-4d84-aec8-01733bd8d857 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-30f1db7b-4952-4d84-aec8-01733bd8d857 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-30f1db7b-4952-4d84-aec8-01733bd8d857 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-30f1db7b-4952-4d84-aec8-01733bd8d857 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-30f1db7b-4952-4d84-aec8-01733bd8d857 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-30f1db7b-4952-4d84-aec8-01733bd8d857 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:03 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-30f1db7b-4952-4d84-aec8-01733bd8d857 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:03 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-30f1db7b-4952-4d84-aec8-01733bd8d857 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 200 len: 1660 microversion: 2.1 time: 0.174890 Apr 13 19:06:03 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 138/418] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:06:02 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 1660 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:06:03 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-5483cc0c-6c5e-4518-b04a-c3c5cf1b09f2 req-e19619d6-b276-49fb-984a-44b8937c5e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-unplugged", "status": "completed", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5483cc0c-6c5e-4518-b04a-c3c5cf1b09f2 req-e19619d6-b276-49fb-984a-44b8937c5e78 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5483cc0c-6c5e-4518-b04a-c3c5cf1b09f2 req-e19619d6-b276-49fb-984a-44b8937c5e78 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5483cc0c-6c5e-4518-b04a-c3c5cf1b09f2 req-e19619d6-b276-49fb-984a-44b8937c5e78 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-5483cc0c-6c5e-4518-b04a-c3c5cf1b09f2 req-e19619d6-b276-49fb-984a-44b8937c5e78 service nova] Creating event network-vif-unplugged:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 19:06:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-5483cc0c-6c5e-4518-b04a-c3c5cf1b09f2 req-e19619d6-b276-49fb-984a-44b8937c5e78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034120 Apr 13 19:06:03 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 143/419] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:03 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/action" status: 202 len: 0 microversion: 2.20 time: 1.025695 Apr 13 19:06:03 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 139/420] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 19:06:02 2023] POST /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/action => generated 0 bytes in 1028 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:06:03 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8edc4b1c-4b27-40e4-acdd-c6bf721765d6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:03 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-8edc4b1c-4b27-40e4-acdd-c6bf721765d6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8edc4b1c-4b27-40e4-acdd-c6bf721765d6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8edc4b1c-4b27-40e4-acdd-c6bf721765d6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8edc4b1c-4b27-40e4-acdd-c6bf721765d6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8edc4b1c-4b27-40e4-acdd-c6bf721765d6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8edc4b1c-4b27-40e4-acdd-c6bf721765d6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8edc4b1c-4b27-40e4-acdd-c6bf721765d6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:04 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-8edc4b1c-4b27-40e4-acdd-c6bf721765d6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:04 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-8edc4b1c-4b27-40e4-acdd-c6bf721765d6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:04 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-8edc4b1c-4b27-40e4-acdd-c6bf721765d6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:04 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-8edc4b1c-4b27-40e4-acdd-c6bf721765d6 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae" status: 200 len: 1712 microversion: 2.20 time: 0.257184 Apr 13 19:06:04 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 139/421] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:06:03 2023] GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae => generated 1712 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:06:04 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-a0f87b98-fd19-48ee-9ac8-36015618f887 req-cab10a9d-41bd-4ed4-a3f9-0386c89f4c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-unplugged", "status": "completed", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-a0f87b98-fd19-48ee-9ac8-36015618f887 req-cab10a9d-41bd-4ed4-a3f9-0386c89f4c12 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-a0f87b98-fd19-48ee-9ac8-36015618f887 req-cab10a9d-41bd-4ed4-a3f9-0386c89f4c12 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-a0f87b98-fd19-48ee-9ac8-36015618f887 req-cab10a9d-41bd-4ed4-a3f9-0386c89f4c12 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:04 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-a0f87b98-fd19-48ee-9ac8-36015618f887 req-cab10a9d-41bd-4ed4-a3f9-0386c89f4c12 service nova] Creating event network-vif-unplugged:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:06:04 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-a0f87b98-fd19-48ee-9ac8-36015618f887 req-cab10a9d-41bd-4ed4-a3f9-0386c89f4c12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030435 Apr 13 19:06:04 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 144/422] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-517cdd89-d4a4-47c3-8981-ecde0b9d5d2f req-cce41dc7-f6b1-405c-b539-45cde530855f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-deleted", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-517cdd89-d4a4-47c3-8981-ecde0b9d5d2f req-cce41dc7-f6b1-405c-b539-45cde530855f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-517cdd89-d4a4-47c3-8981-ecde0b9d5d2f req-cce41dc7-f6b1-405c-b539-45cde530855f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-517cdd89-d4a4-47c3-8981-ecde0b9d5d2f req-cce41dc7-f6b1-405c-b539-45cde530855f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-517cdd89-d4a4-47c3-8981-ecde0b9d5d2f req-cce41dc7-f6b1-405c-b539-45cde530855f service nova] Creating event network-vif-deleted:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 19:06:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-517cdd89-d4a4-47c3-8981-ecde0b9d5d2f req-cce41dc7-f6b1-405c-b539-45cde530855f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049037 Apr 13 19:06:05 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 140/423] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:05 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-b100edf8-cd85-4e1a-abc6-3ef89d5b5fb5 req-4b6c277a-6220-4c38-a14a-bd3aa33a5f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15c1b5e-1769-490a-b81f-09333cd4a227", "name": "network-vif-plugged", "status": "completed", "tag": "a9907d23-585e-46b6-935d-d2d1f7d840f2"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b100edf8-cd85-4e1a-abc6-3ef89d5b5fb5 req-4b6c277a-6220-4c38-a14a-bd3aa33a5f39 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b100edf8-cd85-4e1a-abc6-3ef89d5b5fb5 req-4b6c277a-6220-4c38-a14a-bd3aa33a5f39 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b100edf8-cd85-4e1a-abc6-3ef89d5b5fb5 req-4b6c277a-6220-4c38-a14a-bd3aa33a5f39 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:05 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-b100edf8-cd85-4e1a-abc6-3ef89d5b5fb5 req-4b6c277a-6220-4c38-a14a-bd3aa33a5f39 service nova] Creating event network-vif-plugged:a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 on user Apr 13 19:06:05 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-b100edf8-cd85-4e1a-abc6-3ef89d5b5fb5 req-4b6c277a-6220-4c38-a14a-bd3aa33a5f39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034537 Apr 13 19:06:05 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 140/424] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:06 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-plugged", "status": "completed", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}, {"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-plugged", "status": "completed", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}, {"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-plugged", "status": "completed", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}, {"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-unplugged", "status": "completed", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}, {"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-plugged", "status": "completed", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:06 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Creating event network-vif-plugged:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:06:06 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Creating event network-vif-plugged:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:06:06 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Creating event network-vif-plugged:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:06:06 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Creating event network-vif-unplugged:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:06:06 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Creating event network-vif-plugged:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:06:06 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.035751 Apr 13 19:06:06 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 145/425] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:06 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] Creating event network-changed:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:06:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037297 Apr 13 19:06:09 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 141/426] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:11 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e10368bf-dc01-42c1-80fe-03b131efba53 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Action: 'create', calling method: .version_select at 0x7efe33e6a4d0>, body: {"keypair": {"name": "tempest-keypair-1586634884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg=="}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:11 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-e10368bf-dc01-42c1-80fe-03b131efba53 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Getting quotas for project 2d8f6086043e47289bafbe341f3379d5. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:06:11 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-e10368bf-dc01-42c1-80fe-03b131efba53 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Getting quotas for user 8649dbc1659844ef9b98ae022beda26a and project 2d8f6086043e47289bafbe341f3379d5. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:06:11 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e10368bf-dc01-42c1-80fe-03b131efba53 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.047855 Apr 13 19:06:11 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 141/427] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 19:06:11 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Apr 13 19:06:13 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1531978506", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "63a9c9d2-0f2a-4643-b048-dcf2389044cc"}, {"port": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "tag": "port-1"}, {"port": "d4f7e511-017c-4a16-8e0c-21f468f87027", "tag": "port-2"}, {"uuid": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "tag": "net-1"}, {"uuid": "99dd60fd-7619-4a54-aaa4-c8e0ab450889"}, {"uuid": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5e14c389-bd5a-4d04-aa08-2c6733b87b8b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "12c42f5e-32d2-4365-b2e4-096988f7b407", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "304fa834-218d-40d5-a6d1-3b17810e41d7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--489069076"}], "key_name": "tempest-keypair-1586634884", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:13 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] validate_networks() for [('63a9c9d2-0f2a-4643-b048-dcf2389044cc', None, None, None, None, None), (None, None, '1ea157b6-07a2-4ff3-b11f-b7ea88de6e12', None, None, None), (None, None, 'd4f7e511-017c-4a16-8e0c-21f468f87027', None, None, None), ('99dd60fd-7619-4a54-aaa4-c8e0ab450889', None, None, None, None, None), ('99dd60fd-7619-4a54-aaa4-c8e0ab450889', None, None, None, None, None), ('1dfc8e0b-1385-4707-af71-f2b785cb8ff7', '10.2.2.100', None, None, None, None), ('1dfc8e0b-1385-4707-af71-f2b785cb8ff7', '10.2.2.200', None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:06:13 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-642fd91d-3b6d-44cc-a936-0216885f348c tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:13 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-642fd91d-3b6d-44cc-a936-0216885f348c tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-642fd91d-3b6d-44cc-a936-0216885f348c tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-642fd91d-3b6d-44cc-a936-0216885f348c tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-642fd91d-3b6d-44cc-a936-0216885f348c tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-642fd91d-3b6d-44cc-a936-0216885f348c tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-642fd91d-3b6d-44cc-a936-0216885f348c tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-642fd91d-3b6d-44cc-a936-0216885f348c tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:13 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-642fd91d-3b6d-44cc-a936-0216885f348c tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] HTTP exception thrown: Instance f17525a6-e377-4b33-85cd-88a7aaf4569a could not be found. Apr 13 19:06:13 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-642fd91d-3b6d-44cc-a936-0216885f348c tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Request method failure captured: Apr 13 19:06:13 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a HTTP/1.1 Apr 13 19:06:13 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:06:13 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:06:13 user devstack@n-api.service[61588]: Connection: close Apr 13 19:06:13 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:06:13 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:06:13 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:06:13 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:06:13 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBotx2ZM_9G1ZGBLCrl4LdPuMuif2otYt97YnqmlwhHzUsK6HVbp_6Twn9eY83XPXsPwtTDlDzIlMAP_ZMUr1gwRn72lFZ01UPE7Lb3StrwzhEltbae1cO6LsZeUGsWFJGxIgFKBnSkheTVbPlpbDVQ6u6s0l1v4R20quh3bFT9M8M Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Project-Id: a1308cc4c5734de9a9fd83688c8da796 Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Project-Name: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1308cc4c5734de9a9fd83688c8da796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a1308cc4c5734de9a9fd83688c8da796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a1308cc4c5734de9a9fd83688c8da796"}]}] Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Tenant: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Tenant-Id: a1308cc4c5734de9a9fd83688c8da796 Apr 13 19:06:13 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1876599222 Apr 13 19:06:13 user devstack@n-api.service[61588]: X-User: tempest-ServersNegativeTestJSON-1876599222-project-member Apr 13 19:06:13 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:06:13 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:06:13 user devstack@n-api.service[61588]: X-User-Id: 3e7f76b4b7fb4651b3bce0e72f8a4de6 Apr 13 19:06:13 user devstack@n-api.service[61588]: X-User-Name: tempest-ServersNegativeTestJSON-1876599222-project-member Apr 13 19:06:13 user devstack@n-api.service[61588]: method: > Apr 13 19:06:13 user devstack@n-api.service[61588]: exception: Instance f17525a6-e377-4b33-85cd-88a7aaf4569a could not be found. Apr 13 19:06:13 user devstack@n-api.service[61588]: action_args: {'id': 'f17525a6-e377-4b33-85cd-88a7aaf4569a'} Apr 13 19:06:13 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f17525a6-e377-4b33-85cd-88a7aaf4569a could not be found. Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f17525a6-e377-4b33-85cd-88a7aaf4569a could not be found. Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f17525a6-e377-4b33-85cd-88a7aaf4569a could not be found. Apr 13 19:06:13 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:06:13 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-642fd91d-3b6d-44cc-a936-0216885f348c tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Returning 404 to user: Instance f17525a6-e377-4b33-85cd-88a7aaf4569a could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:06:13 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-642fd91d-3b6d-44cc-a936-0216885f348c tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a" status: 404 len: 111 microversion: 2.1 time: 0.027931 Apr 13 19:06:13 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 142/428] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:06:13 2023] GET /compute/v2.1/servers/f17525a6-e377-4b33-85cd-88a7aaf4569a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Getting quotas for project 2d8f6086043e47289bafbe341f3379d5. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Getting quotas for user 8649dbc1659844ef9b98ae022beda26a and project 2d8f6086043e47289bafbe341f3379d5. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:06:15 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5e14c389-bd5a-4d04-aa08-2c6733b87b8b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='12c42f5e-32d2-4365-b2e4-096988f7b407',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='304fa834-218d-40d5-a6d1-3b17810e41d7',volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:06:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 2.542728 Apr 13 19:06:15 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 146/429] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 19:06:13 2023] POST /compute/v2.1/servers => generated 403 bytes in 2544 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 19:06:15 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=24 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:15 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d2cb78a3-1113-4e1a-b0bb-beb80a51bc31 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:15 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-d2cb78a3-1113-4e1a-b0bb-beb80a51bc31 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:15 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-d2cb78a3-1113-4e1a-b0bb-beb80a51bc31 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:15 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-d2cb78a3-1113-4e1a-b0bb-beb80a51bc31 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:15 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-d2cb78a3-1113-4e1a-b0bb-beb80a51bc31 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d2cb78a3-1113-4e1a-b0bb-beb80a51bc31 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf" status: 200 len: 1280 microversion: 2.32 time: 0.071359 Apr 13 19:06:15 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 142/430] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:06:15 2023] GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:06:21 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "tag": "28b89f9c-8af3-4c33-89a9-55c61aaafe03"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:21 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] Creating event network-changed:28b89f9c-8af3-4c33-89a9-55c61aaafe03 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:21 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040896 Apr 13 19:06:21 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 143/431] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:23 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "tag": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12"}, {"name": "network-changed", "server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "tag": "d4f7e511-017c-4a16-8e0c-21f468f87027"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:23 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] Creating event network-changed:1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:23 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] Creating event network-changed:d4f7e511-017c-4a16-8e0c-21f468f87027 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:23 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047037 Apr 13 19:06:23 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 147/432] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:23 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "tag": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22"}, {"name": "network-changed", "server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "tag": "e0eb0dff-32a5-4b83-a302-b1293d0effdc"}, {"name": "network-changed", "server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "tag": "be95859a-0075-4a7d-b4f3-c89c61e54984"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Creating event network-changed:ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Creating event network-changed:e0eb0dff-32a5-4b83-a302-b1293d0effdc for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Creating event network-changed:be95859a-0075-4a7d-b4f3-c89c61e54984 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.044145 Apr 13 19:06:25 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 143/433] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:25 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-36d65786-9c3d-4be7-a050-f5c2697b4099 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:25 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-36d65786-9c3d-4be7-a050-f5c2697b4099 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36d65786-9c3d-4be7-a050-f5c2697b4099 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36d65786-9c3d-4be7-a050-f5c2697b4099 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36d65786-9c3d-4be7-a050-f5c2697b4099 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36d65786-9c3d-4be7-a050-f5c2697b4099 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36d65786-9c3d-4be7-a050-f5c2697b4099 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-36d65786-9c3d-4be7-a050-f5c2697b4099 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:25 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-36d65786-9c3d-4be7-a050-f5c2697b4099 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-36d65786-9c3d-4be7-a050-f5c2697b4099 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1728 microversion: 2.1 time: 0.397543 Apr 13 19:06:25 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 144/434] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:06:25 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1728 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:06:27 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "tag": "5d35454b-179a-4fcc-a56d-445475aa2900"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:27 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:27 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:27 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] Creating event network-changed:5d35454b-179a-4fcc-a56d-445475aa2900 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:27 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033084 Apr 13 19:06:27 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 148/435] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:31 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:31 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-09fe09eb-4b0b-4391-924f-61441242964f tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:31 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-09fe09eb-4b0b-4391-924f-61441242964f tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:31 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-09fe09eb-4b0b-4391-924f-61441242964f tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-09fe09eb-4b0b-4391-924f-61441242964f tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-09fe09eb-4b0b-4391-924f-61441242964f tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-09fe09eb-4b0b-4391-924f-61441242964f tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-09fe09eb-4b0b-4391-924f-61441242964f tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-09fe09eb-4b0b-4391-924f-61441242964f tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:31 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-09fe09eb-4b0b-4391-924f-61441242964f tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7bcc69770a4859904f1b66cece61e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347c59f4ca945399a4323e689460d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:31 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-09fe09eb-4b0b-4391-924f-61441242964f tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d" status: 200 len: 1538 microversion: 2.1 time: 0.286032 Apr 13 19:06:31 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 144/436] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:06:31 2023] GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d => generated 1538 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:06:32 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-b36c3e5f-353b-4bbe-83eb-f31602152003 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:32 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-b36c3e5f-353b-4bbe-83eb-f31602152003 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:32 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=15 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b36c3e5f-353b-4bbe-83eb-f31602152003 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b36c3e5f-353b-4bbe-83eb-f31602152003 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b36c3e5f-353b-4bbe-83eb-f31602152003 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b36c3e5f-353b-4bbe-83eb-f31602152003 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b36c3e5f-353b-4bbe-83eb-f31602152003 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b36c3e5f-353b-4bbe-83eb-f31602152003 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:32 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-b36c3e5f-353b-4bbe-83eb-f31602152003 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:32 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-b36c3e5f-353b-4bbe-83eb-f31602152003 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df" status: 200 len: 1490 microversion: 2.1 time: 0.353177 Apr 13 19:06:32 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 145/437] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:06:32 2023] GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df => generated 1490 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 19:06:33 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb3fb753-ff8d-4dac-ab70-f940233bf25d", "tag": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:33 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:33 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] Creating event network-changed:cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 for instance cb3fb753-ff8d-4dac-ab70-f940233bf25d on user Apr 13 19:06:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051596 Apr 13 19:06:33 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 149/438] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:33 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65b3e6f5-d237-4a98-907e-49350dc04a3c"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:33 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.558023 Apr 13 19:06:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 145/439] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:06:33 2023] POST /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/os-volume_attachments => generated 194 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:38 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-2fa8b37e-7edf-40ee-ae13-2753c775036b req-99eb0c33-0645-4a31-83cb-e2131b2f8bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "28b89f9c-8af3-4c33-89a9-55c61aaafe03"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-2fa8b37e-7edf-40ee-ae13-2753c775036b req-99eb0c33-0645-4a31-83cb-e2131b2f8bfb service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-2fa8b37e-7edf-40ee-ae13-2753c775036b req-99eb0c33-0645-4a31-83cb-e2131b2f8bfb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-2fa8b37e-7edf-40ee-ae13-2753c775036b req-99eb0c33-0645-4a31-83cb-e2131b2f8bfb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:38 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:38 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-2fa8b37e-7edf-40ee-ae13-2753c775036b req-99eb0c33-0645-4a31-83cb-e2131b2f8bfb service nova] Creating event network-vif-plugged:28b89f9c-8af3-4c33-89a9-55c61aaafe03 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:38 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-2fa8b37e-7edf-40ee-ae13-2753c775036b req-99eb0c33-0645-4a31-83cb-e2131b2f8bfb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061493 Apr 13 19:06:38 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 146/440] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:38 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-db1fea7a-3f18-447a-a2c8-cbe93ac42c5f req-91a9e29b-e163-463a-93ea-30f7d8d64f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-db1fea7a-3f18-447a-a2c8-cbe93ac42c5f req-91a9e29b-e163-463a-93ea-30f7d8d64f37 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-db1fea7a-3f18-447a-a2c8-cbe93ac42c5f req-91a9e29b-e163-463a-93ea-30f7d8d64f37 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-db1fea7a-3f18-447a-a2c8-cbe93ac42c5f req-91a9e29b-e163-463a-93ea-30f7d8d64f37 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:38 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-db1fea7a-3f18-447a-a2c8-cbe93ac42c5f req-91a9e29b-e163-463a-93ea-30f7d8d64f37 service nova] Creating event network-vif-plugged:1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:38 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-db1fea7a-3f18-447a-a2c8-cbe93ac42c5f req-91a9e29b-e163-463a-93ea-30f7d8d64f37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042800 Apr 13 19:06:38 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 150/441] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:40 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-53843340-5f79-4ff4-b132-7c69d9ae385a req-01bbf3d7-359d-4729-b87c-2bee47758c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "be95859a-0075-4a7d-b4f3-c89c61e54984"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-53843340-5f79-4ff4-b132-7c69d9ae385a req-01bbf3d7-359d-4729-b87c-2bee47758c25 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-53843340-5f79-4ff4-b132-7c69d9ae385a req-01bbf3d7-359d-4729-b87c-2bee47758c25 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-53843340-5f79-4ff4-b132-7c69d9ae385a req-01bbf3d7-359d-4729-b87c-2bee47758c25 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:40 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-53843340-5f79-4ff4-b132-7c69d9ae385a req-01bbf3d7-359d-4729-b87c-2bee47758c25 service nova] Creating event network-vif-plugged:be95859a-0075-4a7d-b4f3-c89c61e54984 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:40 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-53843340-5f79-4ff4-b132-7c69d9ae385a req-01bbf3d7-359d-4729-b87c-2bee47758c25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035284 Apr 13 19:06:40 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 146/442] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:40 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "28b89f9c-8af3-4c33-89a9-55c61aaafe03"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "5d35454b-179a-4fcc-a56d-445475aa2900"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] Creating event network-vif-plugged:28b89f9c-8af3-4c33-89a9-55c61aaafe03 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] Creating event network-vif-plugged:5d35454b-179a-4fcc-a56d-445475aa2900 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038157 Apr 13 19:06:40 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 147/443] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:40 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "d4f7e511-017c-4a16-8e0c-21f468f87027"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "d4f7e511-017c-4a16-8e0c-21f468f87027"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "e0eb0dff-32a5-4b83-a302-b1293d0effdc"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "e0eb0dff-32a5-4b83-a302-b1293d0effdc"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Creating event network-vif-plugged:1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Creating event network-vif-plugged:d4f7e511-017c-4a16-8e0c-21f468f87027 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Creating event network-vif-plugged:d4f7e511-017c-4a16-8e0c-21f468f87027 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Creating event network-vif-plugged:ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Creating event network-vif-plugged:ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Creating event network-vif-plugged:e0eb0dff-32a5-4b83-a302-b1293d0effdc for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Creating event network-vif-plugged:e0eb0dff-32a5-4b83-a302-b1293d0effdc for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.063558 Apr 13 19:06:40 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 151/444] 10.0.0.210 () {68 vars in 1395 bytes} [Thu Apr 13 19:06:40 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:06:42 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-b81f4892-5b6d-4dcf-997f-234590565d36 req-d81337a7-d8eb-4aed-b22c-88e371e1b9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "be95859a-0075-4a7d-b4f3-c89c61e54984"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b81f4892-5b6d-4dcf-997f-234590565d36 req-d81337a7-d8eb-4aed-b22c-88e371e1b9b8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b81f4892-5b6d-4dcf-997f-234590565d36 req-d81337a7-d8eb-4aed-b22c-88e371e1b9b8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b81f4892-5b6d-4dcf-997f-234590565d36 req-d81337a7-d8eb-4aed-b22c-88e371e1b9b8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:42 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-b81f4892-5b6d-4dcf-997f-234590565d36 req-d81337a7-d8eb-4aed-b22c-88e371e1b9b8 service nova] Creating event network-vif-plugged:be95859a-0075-4a7d-b4f3-c89c61e54984 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:42 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-b81f4892-5b6d-4dcf-997f-234590565d36 req-d81337a7-d8eb-4aed-b22c-88e371e1b9b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036390 Apr 13 19:06:42 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 147/445] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:42 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-220c9cf7-1343-413d-b085-7f337b1e49d6 req-54aee47f-7d73-47b6-8056-4eea84f2e916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "5d35454b-179a-4fcc-a56d-445475aa2900"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-220c9cf7-1343-413d-b085-7f337b1e49d6 req-54aee47f-7d73-47b6-8056-4eea84f2e916 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-220c9cf7-1343-413d-b085-7f337b1e49d6 req-54aee47f-7d73-47b6-8056-4eea84f2e916 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-220c9cf7-1343-413d-b085-7f337b1e49d6 req-54aee47f-7d73-47b6-8056-4eea84f2e916 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-220c9cf7-1343-413d-b085-7f337b1e49d6 req-54aee47f-7d73-47b6-8056-4eea84f2e916 service nova] Creating event network-vif-plugged:5d35454b-179a-4fcc-a56d-445475aa2900 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:06:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-220c9cf7-1343-413d-b085-7f337b1e49d6 req-54aee47f-7d73-47b6-8056-4eea84f2e916 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029557 Apr 13 19:06:42 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 148/446] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:42 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:43 user devstack@n-api.service[61587]: DEBUG nova.objects.instance [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'services' on Instance uuid cb3fb753-ff8d-4dac-ab70-f940233bf25d {{(pid=61587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:06:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/os-volume_attachments/65b3e6f5-d237-4a98-907e-49350dc04a3c" status: 202 len: 0 microversion: 2.1 time: 0.420629 Apr 13 19:06:43 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 152/447] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:06:42 2023] DELETE /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/os-volume_attachments/65b3e6f5-d237-4a98-907e-49350dc04a3c => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:06:43 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e584dfd4-b87f-4409-b634-c21ca74ac5d2 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:43 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e584dfd4-b87f-4409-b634-c21ca74ac5d2 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e584dfd4-b87f-4409-b634-c21ca74ac5d2 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e584dfd4-b87f-4409-b634-c21ca74ac5d2 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e584dfd4-b87f-4409-b634-c21ca74ac5d2 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e584dfd4-b87f-4409-b634-c21ca74ac5d2 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e584dfd4-b87f-4409-b634-c21ca74ac5d2 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e584dfd4-b87f-4409-b634-c21ca74ac5d2 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:43 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e584dfd4-b87f-4409-b634-c21ca74ac5d2 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055211 Apr 13 19:06:43 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 148/448] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:06:43 2023] GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:06:53 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=7 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:53 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=5 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:53 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-3c6a1918-2be9-47a7-9269-49fd930ba566 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:53 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-3c6a1918-2be9-47a7-9269-49fd930ba566 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3c6a1918-2be9-47a7-9269-49fd930ba566 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3c6a1918-2be9-47a7-9269-49fd930ba566 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3c6a1918-2be9-47a7-9269-49fd930ba566 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3c6a1918-2be9-47a7-9269-49fd930ba566 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3c6a1918-2be9-47a7-9269-49fd930ba566 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3c6a1918-2be9-47a7-9269-49fd930ba566 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:53 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-3c6a1918-2be9-47a7-9269-49fd930ba566 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] HTTP exception thrown: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:06:53 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-3c6a1918-2be9-47a7-9269-49fd930ba566 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Request method failure captured: Apr 13 19:06:53 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 HTTP/1.1 Apr 13 19:06:53 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:06:53 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:06:53 user devstack@n-api.service[61588]: Connection: close Apr 13 19:06:53 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:06:53 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:06:53 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:06:53 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:06:53 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBb38ENjgIANqdrX7XrmIMzqcpj_okvZw1mB-TG9-fRWgfosgoAwN6GZu8vJvfLgQWGRDz3YB7_43sKitPC16qn1TDoymQGkMP95CyOcJ3JUksqrQaOV-lIo9FQY5U4p5cZ1G7ekMKMQ1e7NmTOnpkl2UbMh_70ALxLFTV1D8zJTR8 Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Project-Id: 63b52d6508154a918a13b31712b32796 Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Project-Name: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b52d6508154a918a13b31712b32796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63b52d6508154a918a13b31712b32796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b52d6508154a918a13b31712b32796"}]}] Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Tenant: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Tenant-Id: 63b52d6508154a918a13b31712b32796 Apr 13 19:06:53 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:06:53 user devstack@n-api.service[61588]: X-User: tempest-AttachVolumeTestJSON-43043273-project-member Apr 13 19:06:53 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:06:53 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:06:53 user devstack@n-api.service[61588]: X-User-Id: ba70f34af8664dc89fd9851d00d5b96d Apr 13 19:06:53 user devstack@n-api.service[61588]: X-User-Name: tempest-AttachVolumeTestJSON-43043273-project-member Apr 13 19:06:53 user devstack@n-api.service[61588]: method: > Apr 13 19:06:53 user devstack@n-api.service[61588]: exception: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:06:53 user devstack@n-api.service[61588]: action_args: {'id': 'a15c1b5e-1769-490a-b81f-09333cd4a227'} Apr 13 19:06:53 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:06:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:06:53 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-3c6a1918-2be9-47a7-9269-49fd930ba566 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Returning 404 to user: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:06:53 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-3c6a1918-2be9-47a7-9269-49fd930ba566 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 404 len: 111 microversion: 2.1 time: 0.033800 Apr 13 19:06:53 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 149/449] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:06:53 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:06:53 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=7 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:53 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-81483c18-435f-4938-a0bb-2bba1771ea3d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '.version_select at 0x7efe33d0fac0>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-81483c18-435f-4938-a0bb-2bba1771ea3d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245494573" status: 202 len: 0 microversion: 2.1 time: 0.027373 Apr 13 19:06:53 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 153/450] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 19:06:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245494573 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:06:53 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=9 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:53 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:53 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-4d5dcb4a-1bdd-4ec7-aa84-92b47af413e7 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Action: 'create', calling method: .version_select at 0x7efe33eee560>, body: {"keypair": {"name": "tempest-keypair-293682674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnAulYdzoZYhDen0j/UCqj9wvgRtkdJxgu6k5FF+pAw+g1tgcVbg4FL5+E0vKMU+LKWfdF1n4kies8ZDkczIIVHchJ2PqA4lsul63LTo5xP60Cne9rA0PuQcqa4PxWVVw=="}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:54 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-4d5dcb4a-1bdd-4ec7-aa84-92b47af413e7 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting quotas for project 63b52d6508154a918a13b31712b32796. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:06:54 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-4d5dcb4a-1bdd-4ec7-aa84-92b47af413e7 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting quotas for user ba70f34af8664dc89fd9851d00d5b96d and project 63b52d6508154a918a13b31712b32796. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:06:54 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-4d5dcb4a-1bdd-4ec7-aa84-92b47af413e7 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087699 Apr 13 19:06:54 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 149/451] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:06:53 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:06:54 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f7fc9478-e538-4a23-a8d4-e81e0c6d43b0 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:54 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f7fc9478-e538-4a23-a8d4-e81e0c6d43b0 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f7fc9478-e538-4a23-a8d4-e81e0c6d43b0 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f7fc9478-e538-4a23-a8d4-e81e0c6d43b0 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f7fc9478-e538-4a23-a8d4-e81e0c6d43b0 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f7fc9478-e538-4a23-a8d4-e81e0c6d43b0 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f7fc9478-e538-4a23-a8d4-e81e0c6d43b0 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f7fc9478-e538-4a23-a8d4-e81e0c6d43b0 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:54 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-f7fc9478-e538-4a23-a8d4-e81e0c6d43b0 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:54 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-f7fc9478-e538-4a23-a8d4-e81e0c6d43b0 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:54 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-f7fc9478-e538-4a23-a8d4-e81e0c6d43b0 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:54 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-f7fc9478-e538-4a23-a8d4-e81e0c6d43b0 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae" status: 200 len: 1653 microversion: 2.20 time: 0.202458 Apr 13 19:06:54 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 150/452] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:06:54 2023] GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae => generated 1653 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:06:55 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:06:55 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2001415604", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2def9fdd-c85f-497e-b62d-2b5585207128"}], "security_groups": [{"name": "tempest-securitygroup--289906352"}], "key_name": "tempest-keypair-293682674", "user_data": "}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] validate_networks() for [('2def9fdd-c85f-497e-b62d-2b5585207128', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting quotas for project 63b52d6508154a918a13b31712b32796. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting quotas for user ba70f34af8664dc89fd9851d00d5b96d and project 63b52d6508154a918a13b31712b32796. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:06:56 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:06:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.571141 Apr 13 19:06:56 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 154/453] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:06:55 2023] POST /compute/v2.1/servers => generated 399 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:06:56 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-0acc4006-85b7-41c7-afe7-be992241a18d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:06:56 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-0acc4006-85b7-41c7-afe7-be992241a18d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:06:56 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-0acc4006-85b7-41c7-afe7-be992241a18d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:06:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-0acc4006-85b7-41c7-afe7-be992241a18d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" status: 200 len: 1231 microversion: 2.1 time: 0.073255 Apr 13 19:06:56 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 150/454] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:06:56 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 => generated 1231 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:06:59 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04", "tag": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:06:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:06:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:06:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:06:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] Creating event network-changed:3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 for instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 on user Apr 13 19:06:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035275 Apr 13 19:06:59 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 151/455] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:06:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-64bc2df1-194c-44b8-bcee-70e61e34c3a6 req-796f44c6-4017-477c-9dc0-6278dfe0bda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04", "name": "network-vif-plugged", "status": "completed", "tag": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-64bc2df1-194c-44b8-bcee-70e61e34c3a6 req-796f44c6-4017-477c-9dc0-6278dfe0bda2 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-64bc2df1-194c-44b8-bcee-70e61e34c3a6 req-796f44c6-4017-477c-9dc0-6278dfe0bda2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-64bc2df1-194c-44b8-bcee-70e61e34c3a6 req-796f44c6-4017-477c-9dc0-6278dfe0bda2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-64bc2df1-194c-44b8-bcee-70e61e34c3a6 req-796f44c6-4017-477c-9dc0-6278dfe0bda2 service nova] Creating event network-vif-plugged:3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 for instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 on user Apr 13 19:07:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-64bc2df1-194c-44b8-bcee-70e61e34c3a6 req-796f44c6-4017-477c-9dc0-6278dfe0bda2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100533 Apr 13 19:07:01 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 155/456] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:03 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-a9878f9f-5f4f-491f-917e-0c57810d96ce req-71e82532-ef1b-4a37-a552-6b920a3f0f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04", "name": "network-vif-plugged", "status": "completed", "tag": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a9878f9f-5f4f-491f-917e-0c57810d96ce req-71e82532-ef1b-4a37-a552-6b920a3f0f5c service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a9878f9f-5f4f-491f-917e-0c57810d96ce req-71e82532-ef1b-4a37-a552-6b920a3f0f5c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a9878f9f-5f4f-491f-917e-0c57810d96ce req-71e82532-ef1b-4a37-a552-6b920a3f0f5c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:03 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-a9878f9f-5f4f-491f-917e-0c57810d96ce req-71e82532-ef1b-4a37-a552-6b920a3f0f5c service nova] Creating event network-vif-plugged:3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 for instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 on user Apr 13 19:07:03 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-a9878f9f-5f4f-491f-917e-0c57810d96ce req-71e82532-ef1b-4a37-a552-6b920a3f0f5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044979 Apr 13 19:07:03 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 151/457] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:06 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-042881c2-c081-4970-a399-8ea142a3617c tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:07:06 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-042881c2-c081-4970-a399-8ea142a3617c tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-042881c2-c081-4970-a399-8ea142a3617c tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-042881c2-c081-4970-a399-8ea142a3617c tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-042881c2-c081-4970-a399-8ea142a3617c tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-042881c2-c081-4970-a399-8ea142a3617c tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-042881c2-c081-4970-a399-8ea142a3617c tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-042881c2-c081-4970-a399-8ea142a3617c tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:06 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-042881c2-c081-4970-a399-8ea142a3617c tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:07:06 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-042881c2-c081-4970-a399-8ea142a3617c tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:07:06 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-042881c2-c081-4970-a399-8ea142a3617c tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:07:06 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-042881c2-c081-4970-a399-8ea142a3617c tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf" status: 200 len: 2819 microversion: 2.32 time: 0.414956 Apr 13 19:07:06 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 152/458] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:07:06 2023] GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf => generated 2819 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:07:17 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:17 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:17 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:17 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:17 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-64a8dcad-9a8d-4b43-9701-e217fad0446c tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Action: 'create', calling method: .version_select at 0x7efe33d0f5b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-24428880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIq1t/DMvVpTcEEakPI/0JWmf4BthPiZo8lPCqhHBmih4IYVT4syad6jzJ8PVHxlvM4PPItdyY2igXoht4WeZ8Uv1bT9f9eJhSMIlwuyiyywQzUvP/REC4xOo31hpBbNg=="}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:17 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-64a8dcad-9a8d-4b43-9701-e217fad0446c tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Getting quotas for project 20b8fe614f0541009788ffe685720634. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:07:17 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-64a8dcad-9a8d-4b43-9701-e217fad0446c tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Getting quotas for user e44f04fabef14935a4617dd452d3999b and project 20b8fe614f0541009788ffe685720634. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:07:17 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-64a8dcad-9a8d-4b43-9701-e217fad0446c tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.243335 Apr 13 19:07:17 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 156/459] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:07:17 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:21 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-83408209", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-24428880", "security_groups": [{"name": "tempest-secgroup-smoke-1036835923"}], "networks": [{"uuid": "caba0c3f-498e-458e-86ba-f7a0a147a7d7"}], "block_device_mapping_v2": [{"uuid": "c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:21 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:21 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:21 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:21 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] validate_networks() for [('caba0c3f-498e-458e-86ba-f7a0a147a7d7', None, None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Getting quotas for project 20b8fe614f0541009788ffe685720634. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Getting quotas for user e44f04fabef14935a4617dd452d3999b and project 20b8fe614f0541009788ffe685720634. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:07:22 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96',volume_size=None,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:07:22 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.739168 Apr 13 19:07:22 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 152/460] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:07:21 2023] POST /compute/v2.1/servers => generated 404 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:07:22 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4f842efe-1ea0-484e-9dd5-dddcf8d9f377 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:07:22 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-4f842efe-1ea0-484e-9dd5-dddcf8d9f377 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:22 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=8 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:22 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=16 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:22 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-4f842efe-1ea0-484e-9dd5-dddcf8d9f377 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44f04fabef14935a4617dd452d3999b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8fe614f0541009788ffe685720634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:07:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-4f842efe-1ea0-484e-9dd5-dddcf8d9f377 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" status: 200 len: 1080 microversion: 2.1 time: 0.067281 Apr 13 19:07:22 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 153/461] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:07:22 2023] GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => generated 1080 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:07:24 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:24 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] Creating event network-changed:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:07:24 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086145 Apr 13 19:07:24 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 157/462] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:25 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:26 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/action" status: 202 len: 0 microversion: 2.1 time: 0.202824 Apr 13 19:07:26 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 153/463] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:07:25 2023] POST /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:07:26 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-fb33a168-1aed-48eb-8cf8-bcc7551641d4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:07:26 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-fb33a168-1aed-48eb-8cf8-bcc7551641d4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-fb33a168-1aed-48eb-8cf8-bcc7551641d4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-fb33a168-1aed-48eb-8cf8-bcc7551641d4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-fb33a168-1aed-48eb-8cf8-bcc7551641d4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-fb33a168-1aed-48eb-8cf8-bcc7551641d4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-fb33a168-1aed-48eb-8cf8-bcc7551641d4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-fb33a168-1aed-48eb-8cf8-bcc7551641d4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:26 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-fb33a168-1aed-48eb-8cf8-bcc7551641d4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:07:26 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-fb33a168-1aed-48eb-8cf8-bcc7551641d4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1727 microversion: 2.1 time: 0.154858 Apr 13 19:07:26 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 154/464] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:07:26 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:07:27 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-unplugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:27 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] Creating event network-vif-unplugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:07:27 user devstack@n-api.service[61587]: DEBUG nova.compute.api [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 19:07:27 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088778 Apr 13 19:07:27 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 158/465] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:29 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:29 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] Creating event network-vif-plugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:07:29 user devstack@n-api.service[61589]: DEBUG nova.compute.api [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 19:07:29 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038665 Apr 13 19:07:29 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 154/466] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:31 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-dce1d64a-faa6-4901-9992-553693176cef req-0ae8633c-7961-400c-b587-3dd0f607e83a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "name": "network-vif-plugged", "status": "completed", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-dce1d64a-faa6-4901-9992-553693176cef req-0ae8633c-7961-400c-b587-3dd0f607e83a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-dce1d64a-faa6-4901-9992-553693176cef req-0ae8633c-7961-400c-b587-3dd0f607e83a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-dce1d64a-faa6-4901-9992-553693176cef req-0ae8633c-7961-400c-b587-3dd0f607e83a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-dce1d64a-faa6-4901-9992-553693176cef req-0ae8633c-7961-400c-b587-3dd0f607e83a service nova] Creating event network-vif-plugged:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:07:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-dce1d64a-faa6-4901-9992-553693176cef req-0ae8633c-7961-400c-b587-3dd0f607e83a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051617 Apr 13 19:07:31 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 155/467] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:32 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:32 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-7c7393a3-298e-44fd-86ab-93c6076cb11c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:07:32 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-7c7393a3-298e-44fd-86ab-93c6076cb11c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:32 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7c7393a3-298e-44fd-86ab-93c6076cb11c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:32 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7c7393a3-298e-44fd-86ab-93c6076cb11c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:32 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7c7393a3-298e-44fd-86ab-93c6076cb11c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:32 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7c7393a3-298e-44fd-86ab-93c6076cb11c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:32 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7c7393a3-298e-44fd-86ab-93c6076cb11c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:32 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7c7393a3-298e-44fd-86ab-93c6076cb11c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:32 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-7c7393a3-298e-44fd-86ab-93c6076cb11c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:07:32 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-7c7393a3-298e-44fd-86ab-93c6076cb11c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f" status: 200 len: 1503 microversion: 2.1 time: 0.148941 Apr 13 19:07:32 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 159/468] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:07:32 2023] GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:07:33 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:33 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:33 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-0f3385b3-6803-49cb-9840-374d36be8298 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:07:33 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-0f3385b3-6803-49cb-9840-374d36be8298 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0f3385b3-6803-49cb-9840-374d36be8298 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0f3385b3-6803-49cb-9840-374d36be8298 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0f3385b3-6803-49cb-9840-374d36be8298 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0f3385b3-6803-49cb-9840-374d36be8298 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0f3385b3-6803-49cb-9840-374d36be8298 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0f3385b3-6803-49cb-9840-374d36be8298 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:33 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-0f3385b3-6803-49cb-9840-374d36be8298 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047245 Apr 13 19:07:33 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 155/469] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:07:33 2023] GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:07:33 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:33 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-fda62af7-466e-4d03-83f7-78898fc806e3 req-80e95c26-ece0-423b-b771-d83a936c7be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "name": "network-vif-plugged", "status": "completed", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-fda62af7-466e-4d03-83f7-78898fc806e3 req-80e95c26-ece0-423b-b771-d83a936c7be8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-fda62af7-466e-4d03-83f7-78898fc806e3 req-80e95c26-ece0-423b-b771-d83a936c7be8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-fda62af7-466e-4d03-83f7-78898fc806e3 req-80e95c26-ece0-423b-b771-d83a936c7be8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:33 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-fda62af7-466e-4d03-83f7-78898fc806e3 req-80e95c26-ece0-423b-b771-d83a936c7be8 service nova] Creating event network-vif-plugged:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:07:33 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-fda62af7-466e-4d03-83f7-78898fc806e3 req-80e95c26-ece0-423b-b771-d83a936c7be8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032753 Apr 13 19:07:33 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 156/470] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:35 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1463536675"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:35 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:36 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/action" status: 202 len: 0 microversion: 2.1 time: 0.903572 Apr 13 19:07:36 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 160/471] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:07:35 2023] POST /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/action => generated 0 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 19:07:39 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:39 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] Creating event network-vif-plugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:07:39 user devstack@n-api.service[61589]: DEBUG nova.compute.api [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 19:07:39 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069576 Apr 13 19:07:39 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 156/472] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:41 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-16f1ada7-4c59-4c20-af0e-170d6083acd8 req-1bb0591d-7055-48c6-9894-e9d283573e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-16f1ada7-4c59-4c20-af0e-170d6083acd8 req-1bb0591d-7055-48c6-9894-e9d283573e1b service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-16f1ada7-4c59-4c20-af0e-170d6083acd8 req-1bb0591d-7055-48c6-9894-e9d283573e1b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-16f1ada7-4c59-4c20-af0e-170d6083acd8 req-1bb0591d-7055-48c6-9894-e9d283573e1b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:41 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-16f1ada7-4c59-4c20-af0e-170d6083acd8 req-1bb0591d-7055-48c6-9894-e9d283573e1b service nova] Creating event network-vif-plugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:07:41 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-16f1ada7-4c59-4c20-af0e-170d6083acd8 req-1bb0591d-7055-48c6-9894-e9d283573e1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049108 Apr 13 19:07:41 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 157/473] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:07:46 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-386852633", "imageRef": "9d6be829-be2c-4e1a-bcdd-c919a67a76ec", "flavorRef": "42", "key_name": "tempest-TestStampPattern-550784019", "security_groups": [{"name": "tempest-secgroup-smoke-1896646470"}], "networks": [{"uuid": "a5157bcb-9174-46af-b786-e4b159907e6e"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:46 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:46 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:46 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] validate_networks() for [('a5157bcb-9174-46af-b786-e4b159907e6e', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:07:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e26155fd-0840-41af-90de-a2e36c0fad42 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:07:46 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e26155fd-0840-41af-90de-a2e36c0fad42 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e26155fd-0840-41af-90de-a2e36c0fad42 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e26155fd-0840-41af-90de-a2e36c0fad42 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e26155fd-0840-41af-90de-a2e36c0fad42 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e26155fd-0840-41af-90de-a2e36c0fad42 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e26155fd-0840-41af-90de-a2e36c0fad42 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e26155fd-0840-41af-90de-a2e36c0fad42 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:46 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-e26155fd-0840-41af-90de-a2e36c0fad42 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:07:46 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e26155fd-0840-41af-90de-a2e36c0fad42 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" status: 200 len: 1536 microversion: 2.1 time: 0.290983 Apr 13 19:07:46 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 157/474] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:07:46 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 => generated 1536 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Getting quotas for project 3347c59f4ca945399a4323e689460d12. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Getting quotas for user cb7bcc69770a4859904f1b66cece61e3 and project 3347c59f4ca945399a4323e689460d12. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:07:47 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d6be829-be2c-4e1a-bcdd-c919a67a76ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:07:47 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.573699 Apr 13 19:07:47 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 161/475] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:07:46 2023] POST /compute/v2.1/servers => generated 404 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:07:47 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-6e7864e6-0f29-4b15-b8e3-e537fc0ad00a tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:07:47 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-6e7864e6-0f29-4b15-b8e3-e537fc0ad00a tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:47 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-6e7864e6-0f29-4b15-b8e3-e537fc0ad00a tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7bcc69770a4859904f1b66cece61e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347c59f4ca945399a4323e689460d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:07:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-6e7864e6-0f29-4b15-b8e3-e537fc0ad00a tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b" status: 200 len: 1235 microversion: 2.1 time: 0.068804 Apr 13 19:07:47 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 158/476] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:07:47 2023] GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b => generated 1235 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:07:49 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32751522-5725-4cb4-a8bd-234dfe84780b", "tag": "24610878-c15b-4646-9dcf-ef49c99ae208"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] Creating event network-changed:24610878-c15b-4646-9dcf-ef49c99ae208 for instance 32751522-5725-4cb4-a8bd-234dfe84780b on user Apr 13 19:07:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031223 Apr 13 19:07:49 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 158/477] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:52 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-a06b07a6-98e9-4591-a9a9-a768ee0885fb req-6e41545d-2953-44ba-a1d9-049baaeb6323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32751522-5725-4cb4-a8bd-234dfe84780b", "name": "network-vif-plugged", "status": "completed", "tag": "24610878-c15b-4646-9dcf-ef49c99ae208"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-a06b07a6-98e9-4591-a9a9-a768ee0885fb req-6e41545d-2953-44ba-a1d9-049baaeb6323 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-a06b07a6-98e9-4591-a9a9-a768ee0885fb req-6e41545d-2953-44ba-a1d9-049baaeb6323 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-a06b07a6-98e9-4591-a9a9-a768ee0885fb req-6e41545d-2953-44ba-a1d9-049baaeb6323 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:52 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-a06b07a6-98e9-4591-a9a9-a768ee0885fb req-6e41545d-2953-44ba-a1d9-049baaeb6323 service nova] Creating event network-vif-plugged:24610878-c15b-4646-9dcf-ef49c99ae208 for instance 32751522-5725-4cb4-a8bd-234dfe84780b on user Apr 13 19:07:52 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-a06b07a6-98e9-4591-a9a9-a768ee0885fb req-6e41545d-2953-44ba-a1d9-049baaeb6323 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034197 Apr 13 19:07:52 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 162/478] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:54 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-d1bf0094-bf05-4596-b910-72082326ee11 req-c325723b-421a-43c1-bd36-174beb57f9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32751522-5725-4cb4-a8bd-234dfe84780b", "name": "network-vif-plugged", "status": "completed", "tag": "24610878-c15b-4646-9dcf-ef49c99ae208"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:54 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=12 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:54 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=17 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-d1bf0094-bf05-4596-b910-72082326ee11 req-c325723b-421a-43c1-bd36-174beb57f9c9 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-d1bf0094-bf05-4596-b910-72082326ee11 req-c325723b-421a-43c1-bd36-174beb57f9c9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-d1bf0094-bf05-4596-b910-72082326ee11 req-c325723b-421a-43c1-bd36-174beb57f9c9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:54 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-d1bf0094-bf05-4596-b910-72082326ee11 req-c325723b-421a-43c1-bd36-174beb57f9c9 service nova] Creating event network-vif-plugged:24610878-c15b-4646-9dcf-ef49c99ae208 for instance 32751522-5725-4cb4-a8bd-234dfe84780b on user Apr 13 19:07:54 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-d1bf0094-bf05-4596-b910-72082326ee11 req-c325723b-421a-43c1-bd36-174beb57f9c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036703 Apr 13 19:07:54 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 159/479] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:07:54 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7aa02841-b2f3-418d-947f-a3b622f7ac76 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a52c5670-298b-4c1c-a4c5-f22da0c1d97a"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:54 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-7aa02841-b2f3-418d-947f-a3b622f7ac76 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:54 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7aa02841-b2f3-418d-947f-a3b622f7ac76 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7aa02841-b2f3-418d-947f-a3b622f7ac76 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7aa02841-b2f3-418d-947f-a3b622f7ac76 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7aa02841-b2f3-418d-947f-a3b622f7ac76 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7aa02841-b2f3-418d-947f-a3b622f7ac76 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7aa02841-b2f3-418d-947f-a3b622f7ac76 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:54 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:54 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7aa02841-b2f3-418d-947f-a3b622f7ac76 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.429871 Apr 13 19:07:54 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 159/480] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 19:07:54 2023] POST /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/os-volume_attachments => generated 188 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 19:07:54 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-49157343-2287-43d0-944a-a28c1aebc4b8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:07:54 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-49157343-2287-43d0-944a-a28c1aebc4b8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-49157343-2287-43d0-944a-a28c1aebc4b8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-49157343-2287-43d0-944a-a28c1aebc4b8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-49157343-2287-43d0-944a-a28c1aebc4b8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-49157343-2287-43d0-944a-a28c1aebc4b8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-49157343-2287-43d0-944a-a28c1aebc4b8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-49157343-2287-43d0-944a-a28c1aebc4b8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:55 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-49157343-2287-43d0-944a-a28c1aebc4b8 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/os-volume_attachments/a52c5670-298b-4c1c-a4c5-f22da0c1d97a" status: 202 len: 0 microversion: 2.20 time: 0.234445 Apr 13 19:07:55 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 163/481] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 19:07:54 2023] DELETE /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/os-volume_attachments/a52c5670-298b-4c1c-a4c5-f22da0c1d97a => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:07:55 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:55 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:55 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61588) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 19:07:55 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/action" status: 202 len: 0 microversion: 2.20 time: 0.118492 Apr 13 19:07:55 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 160/482] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 19:07:55 2023] POST /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:07:55 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-54ce17da-b324-4847-92c7-977e4457a82b tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:07:55 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-54ce17da-b324-4847-92c7-977e4457a82b tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:07:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-54ce17da-b324-4847-92c7-977e4457a82b tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-54ce17da-b324-4847-92c7-977e4457a82b tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-54ce17da-b324-4847-92c7-977e4457a82b tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-54ce17da-b324-4847-92c7-977e4457a82b tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-54ce17da-b324-4847-92c7-977e4457a82b tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-54ce17da-b324-4847-92c7-977e4457a82b tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:55 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-54ce17da-b324-4847-92c7-977e4457a82b tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:07:55 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-54ce17da-b324-4847-92c7-977e4457a82b tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:07:55 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-54ce17da-b324-4847-92c7-977e4457a82b tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:07:55 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-54ce17da-b324-4847-92c7-977e4457a82b tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae" status: 200 len: 1661 microversion: 2.20 time: 0.170227 Apr 13 19:07:55 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 160/483] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:07:55 2023] GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae => generated 1661 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:07:57 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:07:57 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:57 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:07:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:07:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:07:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:07:57 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] Creating event network-changed:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:07:57 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031424 Apr 13 19:07:57 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 164/484] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:07:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:04 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-1ae1dc17-fbf9-4956-95f1-84f8e63ae19b req-772c7232-a61f-4112-95f7-fe9a1b3f4f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-plugged", "status": "completed", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:04 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:08:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-1ae1dc17-fbf9-4956-95f1-84f8e63ae19b req-772c7232-a61f-4112-95f7-fe9a1b3f4f0a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-1ae1dc17-fbf9-4956-95f1-84f8e63ae19b req-772c7232-a61f-4112-95f7-fe9a1b3f4f0a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-1ae1dc17-fbf9-4956-95f1-84f8e63ae19b req-772c7232-a61f-4112-95f7-fe9a1b3f4f0a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:04 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-1ae1dc17-fbf9-4956-95f1-84f8e63ae19b req-772c7232-a61f-4112-95f7-fe9a1b3f4f0a service nova] Creating event network-vif-plugged:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:08:04 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-1ae1dc17-fbf9-4956-95f1-84f8e63ae19b req-772c7232-a61f-4112-95f7-fe9a1b3f4f0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066564 Apr 13 19:08:04 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 161/485] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:06 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-67a1e4da-6578-4268-a09a-25b07fd49a7a req-3b27e999-a85d-44d4-aaa5-5b6d0e1f226f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-plugged", "status": "completed", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:06 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:08:06 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:08:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-67a1e4da-6578-4268-a09a-25b07fd49a7a req-3b27e999-a85d-44d4-aaa5-5b6d0e1f226f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-67a1e4da-6578-4268-a09a-25b07fd49a7a req-3b27e999-a85d-44d4-aaa5-5b6d0e1f226f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-67a1e4da-6578-4268-a09a-25b07fd49a7a req-3b27e999-a85d-44d4-aaa5-5b6d0e1f226f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:06 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-67a1e4da-6578-4268-a09a-25b07fd49a7a req-3b27e999-a85d-44d4-aaa5-5b6d0e1f226f service nova] Creating event network-vif-plugged:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:08:06 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-67a1e4da-6578-4268-a09a-25b07fd49a7a req-3b27e999-a85d-44d4-aaa5-5b6d0e1f226f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037327 Apr 13 19:08:06 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 161/486] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:06 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a19c1799-7466-40f5-ae3e-ee8ff1cf757e tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:06 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-a19c1799-7466-40f5-ae3e-ee8ff1cf757e tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a19c1799-7466-40f5-ae3e-ee8ff1cf757e tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a19c1799-7466-40f5-ae3e-ee8ff1cf757e tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a19c1799-7466-40f5-ae3e-ee8ff1cf757e tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a19c1799-7466-40f5-ae3e-ee8ff1cf757e tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a19c1799-7466-40f5-ae3e-ee8ff1cf757e tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a19c1799-7466-40f5-ae3e-ee8ff1cf757e tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:06 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a19c1799-7466-40f5-ae3e-ee8ff1cf757e tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.140120 Apr 13 19:08:06 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 165/487] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 19:08:06 2023] GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf/os-interface => generated 1828 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:08:07 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d35f7134-7721-4e48-bd44-9a3cc0ee4015 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:07 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-d35f7134-7721-4e48-bd44-9a3cc0ee4015 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d35f7134-7721-4e48-bd44-9a3cc0ee4015 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d35f7134-7721-4e48-bd44-9a3cc0ee4015 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d35f7134-7721-4e48-bd44-9a3cc0ee4015 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d35f7134-7721-4e48-bd44-9a3cc0ee4015 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d35f7134-7721-4e48-bd44-9a3cc0ee4015 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d35f7134-7721-4e48-bd44-9a3cc0ee4015 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:07 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-d35f7134-7721-4e48-bd44-9a3cc0ee4015 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:07 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-d35f7134-7721-4e48-bd44-9a3cc0ee4015 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:07 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-d35f7134-7721-4e48-bd44-9a3cc0ee4015 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:07 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-d35f7134-7721-4e48-bd44-9a3cc0ee4015 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf" status: 200 len: 2819 microversion: 2.32 time: 0.231690 Apr 13 19:08:07 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 162/488] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:08:07 2023] GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf => generated 2819 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:08:07 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-37cf256b-d797-4744-a018-fb7fff85e20b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:07 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-37cf256b-d797-4744-a018-fb7fff85e20b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-37cf256b-d797-4744-a018-fb7fff85e20b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-37cf256b-d797-4744-a018-fb7fff85e20b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-37cf256b-d797-4744-a018-fb7fff85e20b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-37cf256b-d797-4744-a018-fb7fff85e20b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-37cf256b-d797-4744-a018-fb7fff85e20b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-37cf256b-d797-4744-a018-fb7fff85e20b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:07 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-37cf256b-d797-4744-a018-fb7fff85e20b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.123762 Apr 13 19:08:07 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 162/489] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 19:08:07 2023] GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf/os-interface => generated 1828 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:08:08 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "tag": "28b89f9c-8af3-4c33-89a9-55c61aaafe03"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:08 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] Creating event network-changed:28b89f9c-8af3-4c33-89a9-55c61aaafe03 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:08 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036003 Apr 13 19:08:08 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 166/490] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:08:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf" status: 204 len: 0 microversion: 2.32 time: 0.119918 Apr 13 19:08:09 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 163/491] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:08:09 2023] DELETE /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 19:08:09 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8df1ebc7-80f5-476d-8a86-483e22571bfe tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:09 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-8df1ebc7-80f5-476d-8a86-483e22571bfe tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8df1ebc7-80f5-476d-8a86-483e22571bfe tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8df1ebc7-80f5-476d-8a86-483e22571bfe tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8df1ebc7-80f5-476d-8a86-483e22571bfe tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8df1ebc7-80f5-476d-8a86-483e22571bfe tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8df1ebc7-80f5-476d-8a86-483e22571bfe tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8df1ebc7-80f5-476d-8a86-483e22571bfe tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:09 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-8df1ebc7-80f5-476d-8a86-483e22571bfe tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:09 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-8df1ebc7-80f5-476d-8a86-483e22571bfe tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:09 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-8df1ebc7-80f5-476d-8a86-483e22571bfe tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:09 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-8df1ebc7-80f5-476d-8a86-483e22571bfe tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf" status: 200 len: 2943 microversion: 2.32 time: 0.220618 Apr 13 19:08:09 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 163/492] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:08:09 2023] GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf => generated 2943 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:08:09 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-41335e95-68bb-40ff-807b-6a9f45d034e5 req-09e0e5c2-0c5d-4e5a-bf14-8e9eb5215ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-unplugged", "status": "completed", "tag": "28b89f9c-8af3-4c33-89a9-55c61aaafe03"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-41335e95-68bb-40ff-807b-6a9f45d034e5 req-09e0e5c2-0c5d-4e5a-bf14-8e9eb5215ad4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-41335e95-68bb-40ff-807b-6a9f45d034e5 req-09e0e5c2-0c5d-4e5a-bf14-8e9eb5215ad4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-41335e95-68bb-40ff-807b-6a9f45d034e5 req-09e0e5c2-0c5d-4e5a-bf14-8e9eb5215ad4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:09 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-41335e95-68bb-40ff-807b-6a9f45d034e5 req-09e0e5c2-0c5d-4e5a-bf14-8e9eb5215ad4 service nova] Creating event network-vif-unplugged:28b89f9c-8af3-4c33-89a9-55c61aaafe03 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:09 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-41335e95-68bb-40ff-807b-6a9f45d034e5 req-09e0e5c2-0c5d-4e5a-bf14-8e9eb5215ad4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046303 Apr 13 19:08:09 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 167/493] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-8119e330-8482-4e32-870c-4ef08ede4f8c req-f9db4040-1f6b-438d-9348-45934f307b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-unplugged", "status": "completed", "tag": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-8119e330-8482-4e32-870c-4ef08ede4f8c req-f9db4040-1f6b-438d-9348-45934f307b74 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-8119e330-8482-4e32-870c-4ef08ede4f8c req-f9db4040-1f6b-438d-9348-45934f307b74 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-8119e330-8482-4e32-870c-4ef08ede4f8c req-f9db4040-1f6b-438d-9348-45934f307b74 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-8119e330-8482-4e32-870c-4ef08ede4f8c req-f9db4040-1f6b-438d-9348-45934f307b74 service nova] Creating event network-vif-unplugged:1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-8119e330-8482-4e32-870c-4ef08ede4f8c req-f9db4040-1f6b-438d-9348-45934f307b74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032811 Apr 13 19:08:09 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 164/494] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:10 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-4bca9c59-b041-4a5f-a09c-44c0afa685a7 req-39805ba5-df28-490c-9a9f-79711c4f66e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-unplugged", "status": "completed", "tag": "be95859a-0075-4a7d-b4f3-c89c61e54984"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-4bca9c59-b041-4a5f-a09c-44c0afa685a7 req-39805ba5-df28-490c-9a9f-79711c4f66e9 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-4bca9c59-b041-4a5f-a09c-44c0afa685a7 req-39805ba5-df28-490c-9a9f-79711c4f66e9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-4bca9c59-b041-4a5f-a09c-44c0afa685a7 req-39805ba5-df28-490c-9a9f-79711c4f66e9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:10 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-4bca9c59-b041-4a5f-a09c-44c0afa685a7 req-39805ba5-df28-490c-9a9f-79711c4f66e9 service nova] Creating event network-vif-unplugged:be95859a-0075-4a7d-b4f3-c89c61e54984 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:10 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-4bca9c59-b041-4a5f-a09c-44c0afa685a7 req-39805ba5-df28-490c-9a9f-79711c4f66e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032826 Apr 13 19:08:10 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 164/495] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:11 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "28b89f9c-8af3-4c33-89a9-55c61aaafe03"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-unplugged", "status": "completed", "tag": "5d35454b-179a-4fcc-a56d-445475aa2900"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "5d35454b-179a-4fcc-a56d-445475aa2900"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Creating event network-vif-plugged:28b89f9c-8af3-4c33-89a9-55c61aaafe03 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Creating event network-vif-unplugged:5d35454b-179a-4fcc-a56d-445475aa2900 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Creating event network-vif-plugged:5d35454b-179a-4fcc-a56d-445475aa2900 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.036956 Apr 13 19:08:11 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 168/496] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:11 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:11 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-unplugged", "status": "completed", "tag": "d4f7e511-017c-4a16-8e0c-21f468f87027"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "d4f7e511-017c-4a16-8e0c-21f468f87027"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-unplugged", "status": "completed", "tag": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-unplugged", "status": "completed", "tag": "e0eb0dff-32a5-4b83-a302-b1293d0effdc"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "e0eb0dff-32a5-4b83-a302-b1293d0effdc"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Creating event network-vif-plugged:1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Creating event network-vif-unplugged:d4f7e511-017c-4a16-8e0c-21f468f87027 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Creating event network-vif-plugged:d4f7e511-017c-4a16-8e0c-21f468f87027 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Creating event network-vif-unplugged:ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Creating event network-vif-plugged:ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Creating event network-vif-unplugged:e0eb0dff-32a5-4b83-a302-b1293d0effdc for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Creating event network-vif-plugged:e0eb0dff-32a5-4b83-a302-b1293d0effdc for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.038069 Apr 13 19:08:11 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 165/497] 10.0.0.210 () {68 vars in 1395 bytes} [Thu Apr 13 19:08:11 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:08:12 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-a153dab4-e16c-49c6-aef8-2cb7bd4d9c2f req-7121958b-9b06-48ca-ba5b-ec0c51cd7950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-plugged", "status": "completed", "tag": "be95859a-0075-4a7d-b4f3-c89c61e54984"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a153dab4-e16c-49c6-aef8-2cb7bd4d9c2f req-7121958b-9b06-48ca-ba5b-ec0c51cd7950 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a153dab4-e16c-49c6-aef8-2cb7bd4d9c2f req-7121958b-9b06-48ca-ba5b-ec0c51cd7950 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a153dab4-e16c-49c6-aef8-2cb7bd4d9c2f req-7121958b-9b06-48ca-ba5b-ec0c51cd7950 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-a153dab4-e16c-49c6-aef8-2cb7bd4d9c2f req-7121958b-9b06-48ca-ba5b-ec0c51cd7950 service nova] Creating event network-vif-plugged:be95859a-0075-4a7d-b4f3-c89c61e54984 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-a153dab4-e16c-49c6-aef8-2cb7bd4d9c2f req-7121958b-9b06-48ca-ba5b-ec0c51cd7950 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057656 Apr 13 19:08:12 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 165/498] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:12 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-7d53f778-26ef-464c-b524-48685ca41762 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:12 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-7d53f778-26ef-464c-b524-48685ca41762 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7d53f778-26ef-464c-b524-48685ca41762 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7d53f778-26ef-464c-b524-48685ca41762 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7d53f778-26ef-464c-b524-48685ca41762 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7d53f778-26ef-464c-b524-48685ca41762 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7d53f778-26ef-464c-b524-48685ca41762 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7d53f778-26ef-464c-b524-48685ca41762 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:12 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-7d53f778-26ef-464c-b524-48685ca41762 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44f04fabef14935a4617dd452d3999b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8fe614f0541009788ffe685720634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:12 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-7d53f778-26ef-464c-b524-48685ca41762 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" status: 200 len: 1430 microversion: 2.1 time: 0.156110 Apr 13 19:08:12 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 169/499] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:08:12 2023] GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => generated 1430 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:08:13 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-e39f8d8e-71cf-4d07-92de-96365b783da3 req-0743d847-faf0-4105-a8bd-d6056b5ece91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-deleted", "tag": "be95859a-0075-4a7d-b4f3-c89c61e54984"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e39f8d8e-71cf-4d07-92de-96365b783da3 req-0743d847-faf0-4105-a8bd-d6056b5ece91 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e39f8d8e-71cf-4d07-92de-96365b783da3 req-0743d847-faf0-4105-a8bd-d6056b5ece91 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e39f8d8e-71cf-4d07-92de-96365b783da3 req-0743d847-faf0-4105-a8bd-d6056b5ece91 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:13 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-e39f8d8e-71cf-4d07-92de-96365b783da3 req-0743d847-faf0-4105-a8bd-d6056b5ece91 service nova] Creating event network-vif-deleted:be95859a-0075-4a7d-b4f3-c89c61e54984 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-e39f8d8e-71cf-4d07-92de-96365b783da3 req-0743d847-faf0-4105-a8bd-d6056b5ece91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057287 Apr 13 19:08:14 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 166/500] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:16 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-deleted", "tag": "28b89f9c-8af3-4c33-89a9-55c61aaafe03"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-deleted", "tag": "e0eb0dff-32a5-4b83-a302-b1293d0effdc"}, {"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-deleted", "tag": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] Creating event network-vif-deleted:28b89f9c-8af3-4c33-89a9-55c61aaafe03 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] Creating event network-vif-deleted:e0eb0dff-32a5-4b83-a302-b1293d0effdc for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] Creating event network-vif-deleted:ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.030613 Apr 13 19:08:16 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 166/501] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:16 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:16 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-831e1207-b6b3-4deb-9653-7d2fc13ceefd tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:16 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-831e1207-b6b3-4deb-9653-7d2fc13ceefd tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-831e1207-b6b3-4deb-9653-7d2fc13ceefd tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-831e1207-b6b3-4deb-9653-7d2fc13ceefd tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-831e1207-b6b3-4deb-9653-7d2fc13ceefd tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-831e1207-b6b3-4deb-9653-7d2fc13ceefd tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-831e1207-b6b3-4deb-9653-7d2fc13ceefd tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-831e1207-b6b3-4deb-9653-7d2fc13ceefd tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:16 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-831e1207-b6b3-4deb-9653-7d2fc13ceefd tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:16 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-831e1207-b6b3-4deb-9653-7d2fc13ceefd tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1720 microversion: 2.1 time: 0.161945 Apr 13 19:08:16 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 170/502] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:08:16 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:08:18 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-297e3ffa-118f-4e20-82fb-48eb6acb8f7e req-9845599a-7a45-47e6-8bc2-b8931f68f993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2d4287-0adb-4045-b6e8-25095b5d3bbf", "name": "network-vif-deleted", "tag": "5d35454b-179a-4fcc-a56d-445475aa2900"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-297e3ffa-118f-4e20-82fb-48eb6acb8f7e req-9845599a-7a45-47e6-8bc2-b8931f68f993 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-297e3ffa-118f-4e20-82fb-48eb6acb8f7e req-9845599a-7a45-47e6-8bc2-b8931f68f993 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-297e3ffa-118f-4e20-82fb-48eb6acb8f7e req-9845599a-7a45-47e6-8bc2-b8931f68f993 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:18 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-297e3ffa-118f-4e20-82fb-48eb6acb8f7e req-9845599a-7a45-47e6-8bc2-b8931f68f993 service nova] Creating event network-vif-deleted:5d35454b-179a-4fcc-a56d-445475aa2900 for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf on user Apr 13 19:08:18 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-297e3ffa-118f-4e20-82fb-48eb6acb8f7e req-9845599a-7a45-47e6-8bc2-b8931f68f993 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028389 Apr 13 19:08:18 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 167/503] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:34 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=12 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:08:34 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=18 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:08:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:34 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:34 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'flavor' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:08:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "POST /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/action" status: 200 len: 32 microversion: 2.1 time: 0.198333 Apr 13 19:08:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 167/504] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:08:34 2023] POST /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:08:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0bbfa4bc-7379-415d-90ca-9dc49a5046d9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:34 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-0bbfa4bc-7379-415d-90ca-9dc49a5046d9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:34 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:08:34 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:08:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0bbfa4bc-7379-415d-90ca-9dc49a5046d9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0bbfa4bc-7379-415d-90ca-9dc49a5046d9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0bbfa4bc-7379-415d-90ca-9dc49a5046d9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0bbfa4bc-7379-415d-90ca-9dc49a5046d9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0bbfa4bc-7379-415d-90ca-9dc49a5046d9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0bbfa4bc-7379-415d-90ca-9dc49a5046d9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:34 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-0bbfa4bc-7379-415d-90ca-9dc49a5046d9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:34 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-0bbfa4bc-7379-415d-90ca-9dc49a5046d9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f" status: 200 len: 1509 microversion: 2.1 time: 0.154466 Apr 13 19:08:34 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 171/505] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:08:34 2023] GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:08:35 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:08:35 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:08:35 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-b84772c1-2a4e-4997-95c3-435737324915 req-11456fe2-ee50-4a87-be4c-ba1dcff512bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-unplugged", "status": "completed", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b84772c1-2a4e-4997-95c3-435737324915 req-11456fe2-ee50-4a87-be4c-ba1dcff512bc service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b84772c1-2a4e-4997-95c3-435737324915 req-11456fe2-ee50-4a87-be4c-ba1dcff512bc service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b84772c1-2a4e-4997-95c3-435737324915 req-11456fe2-ee50-4a87-be4c-ba1dcff512bc service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:35 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-b84772c1-2a4e-4997-95c3-435737324915 req-11456fe2-ee50-4a87-be4c-ba1dcff512bc service nova] Creating event network-vif-unplugged:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:08:35 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-b84772c1-2a4e-4997-95c3-435737324915 req-11456fe2-ee50-4a87-be4c-ba1dcff512bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049334 Apr 13 19:08:35 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 168/506] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:08:37 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-31dfc45a-ed80-4ddd-8638-e83996c0ac48 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:37 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-31dfc45a-ed80-4ddd-8638-e83996c0ac48 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-31dfc45a-ed80-4ddd-8638-e83996c0ac48 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-31dfc45a-ed80-4ddd-8638-e83996c0ac48 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-31dfc45a-ed80-4ddd-8638-e83996c0ac48 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-31dfc45a-ed80-4ddd-8638-e83996c0ac48 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-31dfc45a-ed80-4ddd-8638-e83996c0ac48 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-31dfc45a-ed80-4ddd-8638-e83996c0ac48 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:37 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-8e5a00f2-355c-4276-9e4c-ec2affd4e5f9 req-faf83c89-71d0-4750-8ac1-bf22da5d0ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-plugged", "status": "completed", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8e5a00f2-355c-4276-9e4c-ec2affd4e5f9 req-faf83c89-71d0-4750-8ac1-bf22da5d0ce1 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8e5a00f2-355c-4276-9e4c-ec2affd4e5f9 req-faf83c89-71d0-4750-8ac1-bf22da5d0ce1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8e5a00f2-355c-4276-9e4c-ec2affd4e5f9 req-faf83c89-71d0-4750-8ac1-bf22da5d0ce1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:37 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-8e5a00f2-355c-4276-9e4c-ec2affd4e5f9 req-faf83c89-71d0-4750-8ac1-bf22da5d0ce1 service nova] Creating event network-vif-plugged:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:08:37 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-8e5a00f2-355c-4276-9e4c-ec2affd4e5f9 req-faf83c89-71d0-4750-8ac1-bf22da5d0ce1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040509 Apr 13 19:08:37 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 172/507] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:37 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-31dfc45a-ed80-4ddd-8638-e83996c0ac48 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7bcc69770a4859904f1b66cece61e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347c59f4ca945399a4323e689460d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:37 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-31dfc45a-ed80-4ddd-8638-e83996c0ac48 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b" status: 200 len: 1538 microversion: 2.1 time: 0.225763 Apr 13 19:08:37 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 168/508] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:08:37 2023] GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b => generated 1538 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:08:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-plugged", "status": "completed", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}, {"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-plugged", "status": "completed", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] Creating event network-vif-plugged:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:08:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] Creating event network-vif-plugged:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:08:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033464 Apr 13 19:08:39 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 169/509] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:45 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-2351b762-d2c8-45a9-ada1-94878ceb3b05 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:45 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-2351b762-d2c8-45a9-ada1-94878ceb3b05 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:45 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2351b762-d2c8-45a9-ada1-94878ceb3b05 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:45 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2351b762-d2c8-45a9-ada1-94878ceb3b05 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:45 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2351b762-d2c8-45a9-ada1-94878ceb3b05 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:45 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2351b762-d2c8-45a9-ada1-94878ceb3b05 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:45 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2351b762-d2c8-45a9-ada1-94878ceb3b05 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:45 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2351b762-d2c8-45a9-ada1-94878ceb3b05 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:45 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-2351b762-d2c8-45a9-ada1-94878ceb3b05 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:45 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-2351b762-d2c8-45a9-ada1-94878ceb3b05 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:45 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-2351b762-d2c8-45a9-ada1-94878ceb3b05 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:08:45 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-2351b762-d2c8-45a9-ada1-94878ceb3b05 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae" status: 200 len: 1706 microversion: 2.20 time: 0.141239 Apr 13 19:08:45 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 173/510] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:08:45 2023] GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae => generated 1706 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:08:47 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-3ab0ed01-61dc-4630-997b-0e4efd1ea8b5 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:47 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-3ab0ed01-61dc-4630-997b-0e4efd1ea8b5 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3ab0ed01-61dc-4630-997b-0e4efd1ea8b5 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3ab0ed01-61dc-4630-997b-0e4efd1ea8b5 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3ab0ed01-61dc-4630-997b-0e4efd1ea8b5 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3ab0ed01-61dc-4630-997b-0e4efd1ea8b5 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3ab0ed01-61dc-4630-997b-0e4efd1ea8b5 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3ab0ed01-61dc-4630-997b-0e4efd1ea8b5 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-3ab0ed01-61dc-4630-997b-0e4efd1ea8b5 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.088180 Apr 13 19:08:47 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 169/511] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 19:08:47 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-interface => generated 282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:47 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04", "tag": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] Creating event network-changed:3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 for instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 on user Apr 13 19:08:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029858 Apr 13 19:08:47 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 170/512] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:08:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:47 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a7b6ed0b-0166-48e4-8c83-8a308f4d0121 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:47 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-a7b6ed0b-0166-48e4-8c83-8a308f4d0121 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a7b6ed0b-0166-48e4-8c83-8a308f4d0121 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a7b6ed0b-0166-48e4-8c83-8a308f4d0121 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a7b6ed0b-0166-48e4-8c83-8a308f4d0121 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a7b6ed0b-0166-48e4-8c83-8a308f4d0121 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a7b6ed0b-0166-48e4-8c83-8a308f4d0121 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a7b6ed0b-0166-48e4-8c83-8a308f4d0121 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:47 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a7b6ed0b-0166-48e4-8c83-8a308f4d0121 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/ips" status: 200 len: 104 microversion: 2.1 time: 0.034621 Apr 13 19:08:47 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 174/513] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 19:08:47 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/ips => generated 104 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:49 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:49 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279452 Apr 13 19:08:49 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 170/514] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:08:49 2023] POST /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:56 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-dddb967d-f13b-45bc-a9b7-de10b0ef0794 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:56 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-dddb967d-f13b-45bc-a9b7-de10b0ef0794 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dddb967d-f13b-45bc-a9b7-de10b0ef0794 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dddb967d-f13b-45bc-a9b7-de10b0ef0794 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dddb967d-f13b-45bc-a9b7-de10b0ef0794 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dddb967d-f13b-45bc-a9b7-de10b0ef0794 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dddb967d-f13b-45bc-a9b7-de10b0ef0794 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dddb967d-f13b-45bc-a9b7-de10b0ef0794 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:56 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-dddb967d-f13b-45bc-a9b7-de10b0ef0794 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048618 Apr 13 19:08:56 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 171/515] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:08:56 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:56 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1f26db0b-3bf1-435e-bda0-07576d88be28 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:56 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-1f26db0b-3bf1-435e-bda0-07576d88be28 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1f26db0b-3bf1-435e-bda0-07576d88be28 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1f26db0b-3bf1-435e-bda0-07576d88be28 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1f26db0b-3bf1-435e-bda0-07576d88be28 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1f26db0b-3bf1-435e-bda0-07576d88be28 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1f26db0b-3bf1-435e-bda0-07576d88be28 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1f26db0b-3bf1-435e-bda0-07576d88be28 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-1f26db0b-3bf1-435e-bda0-07576d88be28 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments/2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c" status: 200 len: 194 microversion: 2.1 time: 0.048192 Apr 13 19:08:56 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 175/516] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 19:08:56 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments/2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:57 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d6086c1-70cc-4b38-a30b-fd1f584bb221"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:08:57 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:58 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286122 Apr 13 19:08:58 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 171/517] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:08:57 2023] POST /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:08:59 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d72ff565-6b99-4ba3-83a8-efc3f6d12185 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:59 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-d72ff565-6b99-4ba3-83a8-efc3f6d12185 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:08:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d72ff565-6b99-4ba3-83a8-efc3f6d12185 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d72ff565-6b99-4ba3-83a8-efc3f6d12185 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d72ff565-6b99-4ba3-83a8-efc3f6d12185 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d72ff565-6b99-4ba3-83a8-efc3f6d12185 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:08:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d72ff565-6b99-4ba3-83a8-efc3f6d12185 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:08:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d72ff565-6b99-4ba3-83a8-efc3f6d12185 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:08:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-d72ff565-6b99-4ba3-83a8-efc3f6d12185 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] HTTP exception thrown: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:08:59 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d72ff565-6b99-4ba3-83a8-efc3f6d12185 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Request method failure captured: Apr 13 19:08:59 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf HTTP/1.1 Apr 13 19:08:59 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:08:59 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:08:59 user devstack@n-api.service[61588]: Connection: close Apr 13 19:08:59 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:08:59 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:08:59 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:08:59 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:08:59 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFKRkHRpvcTQ6FsLmxqdak1pZWpFYI0BIlOmf_9IG6rtDMwCDLo83xy3M0ThS5AYZ6-gU-n1Q3LX9rWGTjX3WHyW_LXE-NtVO0CKVLKlTOEugtjn7rf-KByRPNrc2DDHe3KieoF2Suw9mcPEIj0BwH5LZQcD1G6YyTjpryJwhI3OGtg Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Project-Id: 2d8f6086043e47289bafbe341f3379d5 Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Project-Name: tempest-TaggedBootDevicesTest-801682052 Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d8f6086043e47289bafbe341f3379d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d8f6086043e47289bafbe341f3379d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d8f6086043e47289bafbe341f3379d5"}]}] Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Tenant: tempest-TaggedBootDevicesTest-801682052 Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Tenant-Id: 2d8f6086043e47289bafbe341f3379d5 Apr 13 19:08:59 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TaggedBootDevicesTest-801682052 Apr 13 19:08:59 user devstack@n-api.service[61588]: X-User: tempest-TaggedBootDevicesTest-801682052-project-member Apr 13 19:08:59 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:08:59 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:08:59 user devstack@n-api.service[61588]: X-User-Id: 8649dbc1659844ef9b98ae022beda26a Apr 13 19:08:59 user devstack@n-api.service[61588]: X-User-Name: tempest-TaggedBootDevicesTest-801682052-project-member Apr 13 19:08:59 user devstack@n-api.service[61588]: method: > Apr 13 19:08:59 user devstack@n-api.service[61588]: exception: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:08:59 user devstack@n-api.service[61588]: action_args: {'id': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf'} Apr 13 19:08:59 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:08:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:08:59 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d72ff565-6b99-4ba3-83a8-efc3f6d12185 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Returning 404 to user: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:08:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-d72ff565-6b99-4ba3-83a8-efc3f6d12185 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf" status: 404 len: 111 microversion: 2.32 time: 0.035991 Apr 13 19:08:59 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 172/518] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:08:59 2023] GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:08:59 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-80d86d04-e2af-403e-8a3c-150f57ad173b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Calling method '.version_select at 0x7efe33d9ff40>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:08:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-80d86d04-e2af-403e-8a3c-150f57ad173b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586634884" status: 204 len: 0 microversion: 2.32 time: 0.032273 Apr 13 19:08:59 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 176/519] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 19:08:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586634884 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 19:09:02 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-56c48f84-6b1f-4c8e-a3ea-c1c0b095d912 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:02 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-56c48f84-6b1f-4c8e-a3ea-c1c0b095d912 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-56c48f84-6b1f-4c8e-a3ea-c1c0b095d912 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-56c48f84-6b1f-4c8e-a3ea-c1c0b095d912 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-56c48f84-6b1f-4c8e-a3ea-c1c0b095d912 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-56c48f84-6b1f-4c8e-a3ea-c1c0b095d912 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-56c48f84-6b1f-4c8e-a3ea-c1c0b095d912 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-56c48f84-6b1f-4c8e-a3ea-c1c0b095d912 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:02 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-56c48f84-6b1f-4c8e-a3ea-c1c0b095d912 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] HTTP exception thrown: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:09:02 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-56c48f84-6b1f-4c8e-a3ea-c1c0b095d912 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Request method failure captured: Apr 13 19:09:02 user devstack@n-api.service[61589]: request: DELETE /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf HTTP/1.1 Apr 13 19:09:02 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:09:02 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:09:02 user devstack@n-api.service[61589]: Connection: close Apr 13 19:09:02 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:09:02 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:09:02 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:09:02 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:09:02 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFKRkHRpvcTQ6FsLmxqdak1pZWpFYI0BIlOmf_9IG6rtDMwCDLo83xy3M0ThS5AYZ6-gU-n1Q3LX9rWGTjX3WHyW_LXE-NtVO0CKVLKlTOEugtjn7rf-KByRPNrc2DDHe3KieoF2Suw9mcPEIj0BwH5LZQcD1G6YyTjpryJwhI3OGtg Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Project-Id: 2d8f6086043e47289bafbe341f3379d5 Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Project-Name: tempest-TaggedBootDevicesTest-801682052 Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d8f6086043e47289bafbe341f3379d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d8f6086043e47289bafbe341f3379d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d8f6086043e47289bafbe341f3379d5"}]}] Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Tenant: tempest-TaggedBootDevicesTest-801682052 Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Tenant-Id: 2d8f6086043e47289bafbe341f3379d5 Apr 13 19:09:02 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-TaggedBootDevicesTest-801682052 Apr 13 19:09:02 user devstack@n-api.service[61589]: X-User: tempest-TaggedBootDevicesTest-801682052-project-member Apr 13 19:09:02 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:09:02 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:09:02 user devstack@n-api.service[61589]: X-User-Id: 8649dbc1659844ef9b98ae022beda26a Apr 13 19:09:02 user devstack@n-api.service[61589]: X-User-Name: tempest-TaggedBootDevicesTest-801682052-project-member Apr 13 19:09:02 user devstack@n-api.service[61589]: method: > Apr 13 19:09:02 user devstack@n-api.service[61589]: exception: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:09:02 user devstack@n-api.service[61589]: action_args: {'id': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf'} Apr 13 19:09:02 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:09:02 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:09:02 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-56c48f84-6b1f-4c8e-a3ea-c1c0b095d912 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Returning 404 to user: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:09:02 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-56c48f84-6b1f-4c8e-a3ea-c1c0b095d912 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf" status: 404 len: 111 microversion: 2.32 time: 0.047915 Apr 13 19:09:02 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 172/520] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:09:02 2023] DELETE /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:09:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d0db763a-df98-4921-aaa5-369be698317b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:02 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-d0db763a-df98-4921-aaa5-369be698317b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d0db763a-df98-4921-aaa5-369be698317b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d0db763a-df98-4921-aaa5-369be698317b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d0db763a-df98-4921-aaa5-369be698317b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d0db763a-df98-4921-aaa5-369be698317b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d0db763a-df98-4921-aaa5-369be698317b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d0db763a-df98-4921-aaa5-369be698317b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-d0db763a-df98-4921-aaa5-369be698317b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] HTTP exception thrown: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:09:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d0db763a-df98-4921-aaa5-369be698317b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Request method failure captured: Apr 13 19:09:02 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf HTTP/1.1 Apr 13 19:09:02 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:09:02 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:09:02 user devstack@n-api.service[61588]: Connection: close Apr 13 19:09:02 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:09:02 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:09:02 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:09:02 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:09:02 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFKRkHRpvcTQ6FsLmxqdak1pZWpFYI0BIlOmf_9IG6rtDMwCDLo83xy3M0ThS5AYZ6-gU-n1Q3LX9rWGTjX3WHyW_LXE-NtVO0CKVLKlTOEugtjn7rf-KByRPNrc2DDHe3KieoF2Suw9mcPEIj0BwH5LZQcD1G6YyTjpryJwhI3OGtg Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Project-Id: 2d8f6086043e47289bafbe341f3379d5 Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Project-Name: tempest-TaggedBootDevicesTest-801682052 Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d8f6086043e47289bafbe341f3379d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d8f6086043e47289bafbe341f3379d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d8f6086043e47289bafbe341f3379d5"}]}] Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Tenant: tempest-TaggedBootDevicesTest-801682052 Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Tenant-Id: 2d8f6086043e47289bafbe341f3379d5 Apr 13 19:09:02 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TaggedBootDevicesTest-801682052 Apr 13 19:09:02 user devstack@n-api.service[61588]: X-User: tempest-TaggedBootDevicesTest-801682052-project-member Apr 13 19:09:02 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:09:02 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:09:02 user devstack@n-api.service[61588]: X-User-Id: 8649dbc1659844ef9b98ae022beda26a Apr 13 19:09:02 user devstack@n-api.service[61588]: X-User-Name: tempest-TaggedBootDevicesTest-801682052-project-member Apr 13 19:09:02 user devstack@n-api.service[61588]: method: > Apr 13 19:09:02 user devstack@n-api.service[61588]: exception: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:09:02 user devstack@n-api.service[61588]: action_args: {'id': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf'} Apr 13 19:09:02 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. Apr 13 19:09:02 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:09:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d0db763a-df98-4921-aaa5-369be698317b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Returning 404 to user: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:09:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-d0db763a-df98-4921-aaa5-369be698317b tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf" status: 404 len: 111 microversion: 2.32 time: 0.033169 Apr 13 19:09:02 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 173/521] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:09:02 2023] GET /compute/v2.1/servers/4e2d4287-0adb-4045-b6e8-25095b5d3bbf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:09:05 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e40848a9-bf76-425f-833a-411b74f0a5bd tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:05 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e40848a9-bf76-425f-833a-411b74f0a5bd tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:05 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e40848a9-bf76-425f-833a-411b74f0a5bd tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e40848a9-bf76-425f-833a-411b74f0a5bd tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e40848a9-bf76-425f-833a-411b74f0a5bd tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e40848a9-bf76-425f-833a-411b74f0a5bd tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e40848a9-bf76-425f-833a-411b74f0a5bd tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e40848a9-bf76-425f-833a-411b74f0a5bd tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:05 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=25 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:05 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e40848a9-bf76-425f-833a-411b74f0a5bd tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053594 Apr 13 19:09:05 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 177/522] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:09:05 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:05 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-617f859c-5b7b-4244-a8b8-aceb315fbcb4 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:05 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-617f859c-5b7b-4244-a8b8-aceb315fbcb4 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:05 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=13 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-617f859c-5b7b-4244-a8b8-aceb315fbcb4 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-617f859c-5b7b-4244-a8b8-aceb315fbcb4 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-617f859c-5b7b-4244-a8b8-aceb315fbcb4 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-617f859c-5b7b-4244-a8b8-aceb315fbcb4 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-617f859c-5b7b-4244-a8b8-aceb315fbcb4 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-617f859c-5b7b-4244-a8b8-aceb315fbcb4 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:05 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:06 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-617f859c-5b7b-4244-a8b8-aceb315fbcb4 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments/2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c" status: 200 len: 194 microversion: 2.1 time: 0.056736 Apr 13 19:09:06 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 173/523] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 19:09:05 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments/2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:06 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:06 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:06 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=13 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:06 user devstack@n-api.service[61588]: DEBUG nova.objects.instance [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'services' on Instance uuid ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=61588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:09:06 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments/2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c" status: 202 len: 0 microversion: 2.1 time: 0.195258 Apr 13 19:09:06 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 174/524] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:09:06 2023] DELETE /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments/2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:09:08 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-9d433b99-2511-4e52-b889-62bc2b806913 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:08 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-9d433b99-2511-4e52-b889-62bc2b806913 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9d433b99-2511-4e52-b889-62bc2b806913 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9d433b99-2511-4e52-b889-62bc2b806913 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9d433b99-2511-4e52-b889-62bc2b806913 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9d433b99-2511-4e52-b889-62bc2b806913 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9d433b99-2511-4e52-b889-62bc2b806913 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9d433b99-2511-4e52-b889-62bc2b806913 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:08 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-9d433b99-2511-4e52-b889-62bc2b806913 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments/9d6086c1-70cc-4b38-a30b-fd1f584bb221" status: 200 len: 194 microversion: 2.1 time: 0.049645 Apr 13 19:09:08 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 178/525] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 19:09:08 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments/9d6086c1-70cc-4b38-a30b-fd1f584bb221 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:08 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:08 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:08 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:08 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:08 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:08 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:08 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:08 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:08 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'services' on Instance uuid ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:09:08 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments/9d6086c1-70cc-4b38-a30b-fd1f584bb221" status: 202 len: 0 microversion: 2.1 time: 0.250092 Apr 13 19:09:08 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 174/526] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:09:08 2023] DELETE /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments/9d6086c1-70cc-4b38-a30b-fd1f584bb221 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-92dad83e-e59c-45f0-b09e-4fbcd78a2827 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-92dad83e-e59c-45f0-b09e-4fbcd78a2827 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-92dad83e-e59c-45f0-b09e-4fbcd78a2827 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-92dad83e-e59c-45f0-b09e-4fbcd78a2827 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-92dad83e-e59c-45f0-b09e-4fbcd78a2827 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-92dad83e-e59c-45f0-b09e-4fbcd78a2827 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-92dad83e-e59c-45f0-b09e-4fbcd78a2827 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-92dad83e-e59c-45f0-b09e-4fbcd78a2827 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-92dad83e-e59c-45f0-b09e-4fbcd78a2827 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054178 Apr 13 19:09:11 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 175/527] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:09:11 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:09:11 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-8cdea370-d025-4ed0-9046-c2bebbaffe13 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:11 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-8cdea370-d025-4ed0-9046-c2bebbaffe13 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8cdea370-d025-4ed0-9046-c2bebbaffe13 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8cdea370-d025-4ed0-9046-c2bebbaffe13 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8cdea370-d025-4ed0-9046-c2bebbaffe13 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8cdea370-d025-4ed0-9046-c2bebbaffe13 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8cdea370-d025-4ed0-9046-c2bebbaffe13 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8cdea370-d025-4ed0-9046-c2bebbaffe13 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-8cdea370-d025-4ed0-9046-c2bebbaffe13 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040653 Apr 13 19:09:11 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 179/528] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:09:11 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:09:11 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:11 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:11 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Going to try to terminate instance {{(pid=61589) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:09:11 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" status: 204 len: 0 microversion: 2.1 time: 0.131589 Apr 13 19:09:11 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 175/529] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:09:11 2023] DELETE /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e8566885-361c-4774-95d2-eb51fa56adb1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e8566885-361c-4774-95d2-eb51fa56adb1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e8566885-361c-4774-95d2-eb51fa56adb1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e8566885-361c-4774-95d2-eb51fa56adb1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e8566885-361c-4774-95d2-eb51fa56adb1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e8566885-361c-4774-95d2-eb51fa56adb1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e8566885-361c-4774-95d2-eb51fa56adb1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e8566885-361c-4774-95d2-eb51fa56adb1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:11 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-e8566885-361c-4774-95d2-eb51fa56adb1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:09:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e8566885-361c-4774-95d2-eb51fa56adb1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" status: 200 len: 1660 microversion: 2.1 time: 0.297858 Apr 13 19:09:11 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 176/530] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:09:11 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 => generated 1660 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:09:11 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-6849f610-37b4-4a86-ab50-bc032fb53eaf req-09455815-c0f2-490b-9893-087f37791487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04", "name": "network-vif-unplugged", "status": "completed", "tag": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6849f610-37b4-4a86-ab50-bc032fb53eaf req-09455815-c0f2-490b-9893-087f37791487 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6849f610-37b4-4a86-ab50-bc032fb53eaf req-09455815-c0f2-490b-9893-087f37791487 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6849f610-37b4-4a86-ab50-bc032fb53eaf req-09455815-c0f2-490b-9893-087f37791487 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-6849f610-37b4-4a86-ab50-bc032fb53eaf req-09455815-c0f2-490b-9893-087f37791487 service nova] Creating event network-vif-unplugged:3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 for instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 on user Apr 13 19:09:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-6849f610-37b4-4a86-ab50-bc032fb53eaf req-09455815-c0f2-490b-9893-087f37791487 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031599 Apr 13 19:09:11 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 180/531] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:12 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d8e896fb-29b5-489f-b108-a2fd35526539 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:12 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-d8e896fb-29b5-489f-b108-a2fd35526539 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d8e896fb-29b5-489f-b108-a2fd35526539 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d8e896fb-29b5-489f-b108-a2fd35526539 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d8e896fb-29b5-489f-b108-a2fd35526539 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d8e896fb-29b5-489f-b108-a2fd35526539 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d8e896fb-29b5-489f-b108-a2fd35526539 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d8e896fb-29b5-489f-b108-a2fd35526539 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:13 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-d8e896fb-29b5-489f-b108-a2fd35526539 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44f04fabef14935a4617dd452d3999b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8fe614f0541009788ffe685720634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:09:13 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d8e896fb-29b5-489f-b108-a2fd35526539 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" status: 200 len: 1430 microversion: 2.1 time: 0.156283 Apr 13 19:09:13 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 176/532] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:09:12 2023] GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => generated 1430 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:09:13 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-7e60ede2-89ae-44ca-bee4-a27eaaae874e req-ad2c3932-52dc-492d-adec-90e4d0a84c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04", "name": "network-vif-deleted", "tag": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7e60ede2-89ae-44ca-bee4-a27eaaae874e req-ad2c3932-52dc-492d-adec-90e4d0a84c0a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7e60ede2-89ae-44ca-bee4-a27eaaae874e req-ad2c3932-52dc-492d-adec-90e4d0a84c0a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7e60ede2-89ae-44ca-bee4-a27eaaae874e req-ad2c3932-52dc-492d-adec-90e4d0a84c0a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:13 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-7e60ede2-89ae-44ca-bee4-a27eaaae874e req-ad2c3932-52dc-492d-adec-90e4d0a84c0a service nova] Creating event network-vif-deleted:3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 for instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 on user Apr 13 19:09:13 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-7e60ede2-89ae-44ca-bee4-a27eaaae874e req-ad2c3932-52dc-492d-adec-90e4d0a84c0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032916 Apr 13 19:09:13 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 177/533] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:14 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-c9b3450b-aa71-4c2a-b309-8ff0f1c2405f req-251224e7-fc0c-4f27-a5af-0283dae09998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04", "name": "network-vif-plugged", "status": "completed", "tag": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-c9b3450b-aa71-4c2a-b309-8ff0f1c2405f req-251224e7-fc0c-4f27-a5af-0283dae09998 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-c9b3450b-aa71-4c2a-b309-8ff0f1c2405f req-251224e7-fc0c-4f27-a5af-0283dae09998 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-c9b3450b-aa71-4c2a-b309-8ff0f1c2405f req-251224e7-fc0c-4f27-a5af-0283dae09998 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:14 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-c9b3450b-aa71-4c2a-b309-8ff0f1c2405f req-251224e7-fc0c-4f27-a5af-0283dae09998 service nova] Creating event network-vif-plugged:3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 for instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 on user Apr 13 19:09:14 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-c9b3450b-aa71-4c2a-b309-8ff0f1c2405f req-251224e7-fc0c-4f27-a5af-0283dae09998 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035503 Apr 13 19:09:14 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 181/534] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:15 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:15 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:15 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lazy-loading 'flavor' on Instance uuid 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:09:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333/action" status: 202 len: 0 microversion: 2.1 time: 0.113882 Apr 13 19:09:15 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 177/535] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:09:15 2023] POST /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 19:09:15 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f23ea4d7-3e64-42ba-87e4-01de0d88f080 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:15 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f23ea4d7-3e64-42ba-87e4-01de0d88f080 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f23ea4d7-3e64-42ba-87e4-01de0d88f080 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f23ea4d7-3e64-42ba-87e4-01de0d88f080 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f23ea4d7-3e64-42ba-87e4-01de0d88f080 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f23ea4d7-3e64-42ba-87e4-01de0d88f080 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f23ea4d7-3e64-42ba-87e4-01de0d88f080 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f23ea4d7-3e64-42ba-87e4-01de0d88f080 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:15 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-f23ea4d7-3e64-42ba-87e4-01de0d88f080 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44f04fabef14935a4617dd452d3999b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8fe614f0541009788ffe685720634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:09:15 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-f23ea4d7-3e64-42ba-87e4-01de0d88f080 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" status: 200 len: 1436 microversion: 2.1 time: 0.262967 Apr 13 19:09:15 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 178/536] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:09:15 2023] GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => generated 1436 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:09:15 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-9703ee79-80a9-41db-9218-bfb32acc40d1 req-db08cc69-045c-4b43-9fc1-98be44b5b5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "name": "network-vif-unplugged", "status": "completed", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-9703ee79-80a9-41db-9218-bfb32acc40d1 req-db08cc69-045c-4b43-9fc1-98be44b5b5e4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-9703ee79-80a9-41db-9218-bfb32acc40d1 req-db08cc69-045c-4b43-9fc1-98be44b5b5e4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-9703ee79-80a9-41db-9218-bfb32acc40d1 req-db08cc69-045c-4b43-9fc1-98be44b5b5e4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-9703ee79-80a9-41db-9218-bfb32acc40d1 req-db08cc69-045c-4b43-9fc1-98be44b5b5e4 service nova] Creating event network-vif-unplugged:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:09:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-9703ee79-80a9-41db-9218-bfb32acc40d1 req-db08cc69-045c-4b43-9fc1-98be44b5b5e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050637 Apr 13 19:09:15 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 182/537] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:16 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] Creating event network-changed:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:09:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039236 Apr 13 19:09:16 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 178/538] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:16 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-1e33a146-542d-4a5f-a6b2-2d6177aafec3 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:16 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-1e33a146-542d-4a5f-a6b2-2d6177aafec3 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1e33a146-542d-4a5f-a6b2-2d6177aafec3 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1e33a146-542d-4a5f-a6b2-2d6177aafec3 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1e33a146-542d-4a5f-a6b2-2d6177aafec3 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1e33a146-542d-4a5f-a6b2-2d6177aafec3 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1e33a146-542d-4a5f-a6b2-2d6177aafec3 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1e33a146-542d-4a5f-a6b2-2d6177aafec3 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:16 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-1e33a146-542d-4a5f-a6b2-2d6177aafec3 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:09:16 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-1e33a146-542d-4a5f-a6b2-2d6177aafec3 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1720 microversion: 2.1 time: 0.176415 Apr 13 19:09:16 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 179/539] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:09:16 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:09:16 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ffe43a2f-023a-4737-b0ef-8300a00b4822 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:16 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-ffe43a2f-023a-4737-b0ef-8300a00b4822 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ffe43a2f-023a-4737-b0ef-8300a00b4822 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ffe43a2f-023a-4737-b0ef-8300a00b4822 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ffe43a2f-023a-4737-b0ef-8300a00b4822 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ffe43a2f-023a-4737-b0ef-8300a00b4822 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ffe43a2f-023a-4737-b0ef-8300a00b4822 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:16 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ffe43a2f-023a-4737-b0ef-8300a00b4822 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:16 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-ffe43a2f-023a-4737-b0ef-8300a00b4822 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:09:16 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-ffe43a2f-023a-4737-b0ef-8300a00b4822 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1720 microversion: 2.1 time: 0.215825 Apr 13 19:09:16 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 183/540] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:09:16 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 19:09:17 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:17 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:17 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:17 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:17 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] Creating event network-changed:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:09:17 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030609 Apr 13 19:09:17 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 179/541] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:17 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-2a277ac8-5875-4b1e-9628-5556e809eaf6 req-f88be216-ded1-494b-bdc0-0060fee37159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "name": "network-vif-plugged", "status": "completed", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-2a277ac8-5875-4b1e-9628-5556e809eaf6 req-f88be216-ded1-494b-bdc0-0060fee37159 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-2a277ac8-5875-4b1e-9628-5556e809eaf6 req-f88be216-ded1-494b-bdc0-0060fee37159 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-2a277ac8-5875-4b1e-9628-5556e809eaf6 req-f88be216-ded1-494b-bdc0-0060fee37159 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:17 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-2a277ac8-5875-4b1e-9628-5556e809eaf6 req-f88be216-ded1-494b-bdc0-0060fee37159 service nova] Creating event network-vif-plugged:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:09:17 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-2a277ac8-5875-4b1e-9628-5556e809eaf6 req-f88be216-ded1-494b-bdc0-0060fee37159 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027569 Apr 13 19:09:17 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 180/542] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:24 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-f387c7d3-ab60-4648-9810-49c9ac96b40c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:24 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-f387c7d3-ab60-4648-9810-49c9ac96b40c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f387c7d3-ab60-4648-9810-49c9ac96b40c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f387c7d3-ab60-4648-9810-49c9ac96b40c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f387c7d3-ab60-4648-9810-49c9ac96b40c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f387c7d3-ab60-4648-9810-49c9ac96b40c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f387c7d3-ab60-4648-9810-49c9ac96b40c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f387c7d3-ab60-4648-9810-49c9ac96b40c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:25 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-f387c7d3-ab60-4648-9810-49c9ac96b40c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:09:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-f387c7d3-ab60-4648-9810-49c9ac96b40c tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f" status: 200 len: 1489 microversion: 2.1 time: 0.479780 Apr 13 19:09:25 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 184/543] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:09:24 2023] GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f => generated 1489 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:09:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7b654893-9699-4daf-897e-342370fa386d tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Action: 'create', calling method: .version_select at 0x7efe33eedfc0>, body: {"keypair": {"name": "tempest-keypair-822105464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/81JXVWb0rXwxJzcsxAa/8RybinXrc8Zl6qDPwrsL1kZEKNSUSm9I+Uhv2Knu1MvtLPpX14zkVbAGUt4k2gfpkYtA+Jt4hwEGaqZykAeWlkK9tm3g1d//gn87QHubXOQ=="}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:25 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-7b654893-9699-4daf-897e-342370fa386d tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Getting quotas for project 7e1ef6e7b159468f90cfc0db2e8e904d. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:09:25 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-7b654893-9699-4daf-897e-342370fa386d tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Getting quotas for user 4a9282b733244da9bf210ddc66b74816 and project 7e1ef6e7b159468f90cfc0db2e8e904d. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:09:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7b654893-9699-4daf-897e-342370fa386d tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133927 Apr 13 19:09:25 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 180/544] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:09:25 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:27 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=13 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:27 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=27 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:27 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-972621465", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "12044ffa-ff1e-492a-b819-a301af851941"}], "security_groups": [{"name": "tempest-securitygroup--1644668790"}], "key_name": "tempest-keypair-822105464", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:27 user devstack@n-api.service[61588]: DEBUG nova.network.neutron [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] validate_networks() for [('12044ffa-ff1e-492a-b819-a301af851941', None, None, None, None, None)] {{(pid=61588) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Flavor limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Image limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Flavor pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Image pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Getting quotas for project 7e1ef6e7b159468f90cfc0db2e8e904d. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Getting quotas for user 4a9282b733244da9bf210ddc66b74816 and project 7e1ef6e7b159468f90cfc0db2e8e904d. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Going to run 1 instances... {{(pid=61588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:09:28 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:09:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.607333 Apr 13 19:09:28 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 181/545] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:09:27 2023] POST /compute/v2.1/servers => generated 404 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:09:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-51747148-b8e8-4b41-8583-867c838b391e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:28 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-51747148-b8e8-4b41-8583-867c838b391e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:28 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-51747148-b8e8-4b41-8583-867c838b391e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9282b733244da9bf210ddc66b74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1ef6e7b159468f90cfc0db2e8e904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:09:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-51747148-b8e8-4b41-8583-867c838b391e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d" status: 200 len: 1238 microversion: 2.1 time: 0.072393 Apr 13 19:09:28 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 185/546] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:09:28 2023] GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:09:30 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:30 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:30 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] Creating event network-changed:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:09:30 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069074 Apr 13 19:09:30 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 181/547] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:33 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-e8f12a9e-3931-4e4e-84ce-d6c8468584e6 req-0ce2ac74-21e7-459b-a317-6793a3d0ab3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-plugged", "status": "completed", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e8f12a9e-3931-4e4e-84ce-d6c8468584e6 req-0ce2ac74-21e7-459b-a317-6793a3d0ab3c service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e8f12a9e-3931-4e4e-84ce-d6c8468584e6 req-0ce2ac74-21e7-459b-a317-6793a3d0ab3c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:33 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e8f12a9e-3931-4e4e-84ce-d6c8468584e6 req-0ce2ac74-21e7-459b-a317-6793a3d0ab3c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:33 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-e8f12a9e-3931-4e4e-84ce-d6c8468584e6 req-0ce2ac74-21e7-459b-a317-6793a3d0ab3c service nova] Creating event network-vif-plugged:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:09:33 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-e8f12a9e-3931-4e4e-84ce-d6c8468584e6 req-0ce2ac74-21e7-459b-a317-6793a3d0ab3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040445 Apr 13 19:09:33 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 182/548] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:35 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-ea18c8aa-70f8-4f9d-b0b3-0d87c3301c47 req-170f4cc0-ab2f-45b7-ab3a-1b3eb9550935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-plugged", "status": "completed", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:35 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=35 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-ea18c8aa-70f8-4f9d-b0b3-0d87c3301c47 req-170f4cc0-ab2f-45b7-ab3a-1b3eb9550935 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-ea18c8aa-70f8-4f9d-b0b3-0d87c3301c47 req-170f4cc0-ab2f-45b7-ab3a-1b3eb9550935 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-ea18c8aa-70f8-4f9d-b0b3-0d87c3301c47 req-170f4cc0-ab2f-45b7-ab3a-1b3eb9550935 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:35 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-ea18c8aa-70f8-4f9d-b0b3-0d87c3301c47 req-170f4cc0-ab2f-45b7-ab3a-1b3eb9550935 service nova] Creating event network-vif-plugged:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:09:35 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-ea18c8aa-70f8-4f9d-b0b3-0d87c3301c47 req-170f4cc0-ab2f-45b7-ab3a-1b3eb9550935 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032254 Apr 13 19:09:35 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 186/549] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:37 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:37 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ac1e2cc1-d6d6-4578-84bd-a5c5ec92f8b5 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:37 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ac1e2cc1-d6d6-4578-84bd-a5c5ec92f8b5 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:37 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ac1e2cc1-d6d6-4578-84bd-a5c5ec92f8b5 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ac1e2cc1-d6d6-4578-84bd-a5c5ec92f8b5 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ac1e2cc1-d6d6-4578-84bd-a5c5ec92f8b5 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ac1e2cc1-d6d6-4578-84bd-a5c5ec92f8b5 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ac1e2cc1-d6d6-4578-84bd-a5c5ec92f8b5 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:37 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ac1e2cc1-d6d6-4578-84bd-a5c5ec92f8b5 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:37 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-ac1e2cc1-d6d6-4578-84bd-a5c5ec92f8b5 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7bcc69770a4859904f1b66cece61e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347c59f4ca945399a4323e689460d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:09:37 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ac1e2cc1-d6d6-4578-84bd-a5c5ec92f8b5 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b" status: 200 len: 1538 microversion: 2.1 time: 0.289280 Apr 13 19:09:37 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 182/550] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:09:37 2023] GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b => generated 1538 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:09:39 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:39 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32751522-5725-4cb4-a8bd-234dfe84780b", "tag": "24610878-c15b-4646-9dcf-ef49c99ae208"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] Creating event network-changed:24610878-c15b-4646-9dcf-ef49c99ae208 for instance 32751522-5725-4cb4-a8bd-234dfe84780b on user Apr 13 19:09:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032880 Apr 13 19:09:39 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 183/551] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:39 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:39 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d1dd6ab-d35d-415e-a184-8b4a46396a07"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:39 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:39 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=22 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:09:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294929 Apr 13 19:09:40 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 187/552] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:09:39 2023] POST /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:45 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9a47621d-4cc4-4dc7-a9a3-6369d7b4e639 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:45 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-9a47621d-4cc4-4dc7-a9a3-6369d7b4e639 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:45 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9a47621d-4cc4-4dc7-a9a3-6369d7b4e639 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:45 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9a47621d-4cc4-4dc7-a9a3-6369d7b4e639 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:45 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9a47621d-4cc4-4dc7-a9a3-6369d7b4e639 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:45 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9a47621d-4cc4-4dc7-a9a3-6369d7b4e639 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:45 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9a47621d-4cc4-4dc7-a9a3-6369d7b4e639 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:45 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9a47621d-4cc4-4dc7-a9a3-6369d7b4e639 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:45 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-9a47621d-4cc4-4dc7-a9a3-6369d7b4e639 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044392 Apr 13 19:09:45 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 183/553] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 19:09:45 2023] GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:09:46 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:46 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:46 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:09:46 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae" status: 204 len: 0 microversion: 2.20 time: 0.151855 Apr 13 19:09:46 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 184/554] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:09:46 2023] DELETE /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 19:09:46 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-88705acf-55a5-4e92-81df-4465a435dcda tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:46 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-88705acf-55a5-4e92-81df-4465a435dcda tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-88705acf-55a5-4e92-81df-4465a435dcda tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-88705acf-55a5-4e92-81df-4465a435dcda tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-88705acf-55a5-4e92-81df-4465a435dcda tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-88705acf-55a5-4e92-81df-4465a435dcda tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-88705acf-55a5-4e92-81df-4465a435dcda tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-88705acf-55a5-4e92-81df-4465a435dcda tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:46 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-88705acf-55a5-4e92-81df-4465a435dcda tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:09:46 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-88705acf-55a5-4e92-81df-4465a435dcda tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:09:46 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-88705acf-55a5-4e92-81df-4465a435dcda tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:09:46 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-88705acf-55a5-4e92-81df-4465a435dcda tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae" status: 200 len: 1712 microversion: 2.20 time: 0.203810 Apr 13 19:09:46 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 188/555] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:09:46 2023] GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae => generated 1712 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:09:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-514c9d9f-fd86-415b-ad24-f0cbcc18f2f9 req-8cf62c91-230f-4de2-88b9-f3abcdc3667d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-unplugged", "status": "completed", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-514c9d9f-fd86-415b-ad24-f0cbcc18f2f9 req-8cf62c91-230f-4de2-88b9-f3abcdc3667d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-514c9d9f-fd86-415b-ad24-f0cbcc18f2f9 req-8cf62c91-230f-4de2-88b9-f3abcdc3667d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-514c9d9f-fd86-415b-ad24-f0cbcc18f2f9 req-8cf62c91-230f-4de2-88b9-f3abcdc3667d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:46 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-514c9d9f-fd86-415b-ad24-f0cbcc18f2f9 req-8cf62c91-230f-4de2-88b9-f3abcdc3667d service nova] Creating event network-vif-unplugged:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:09:46 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-514c9d9f-fd86-415b-ad24-f0cbcc18f2f9 req-8cf62c91-230f-4de2-88b9-f3abcdc3667d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038896 Apr 13 19:09:46 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 184/556] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:09:47 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-7da0123b-6c09-47db-967a-266c0908b38c req-3ca7570a-df4d-4526-85a5-80d8f9900e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-deleted", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7da0123b-6c09-47db-967a-266c0908b38c req-3ca7570a-df4d-4526-85a5-80d8f9900e9f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7da0123b-6c09-47db-967a-266c0908b38c req-3ca7570a-df4d-4526-85a5-80d8f9900e9f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7da0123b-6c09-47db-967a-266c0908b38c req-3ca7570a-df4d-4526-85a5-80d8f9900e9f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-7da0123b-6c09-47db-967a-266c0908b38c req-3ca7570a-df4d-4526-85a5-80d8f9900e9f service nova] Creating event network-vif-deleted:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:09:47 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:47 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-7da0123b-6c09-47db-967a-266c0908b38c req-3ca7570a-df4d-4526-85a5-80d8f9900e9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034675 Apr 13 19:09:47 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 185/557] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:48 user devstack@n-api.service[61587]: DEBUG nova.objects.instance [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'services' on Instance uuid 32751522-5725-4cb4-a8bd-234dfe84780b {{(pid=61587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:09:48 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b/os-volume_attachments/3d1dd6ab-d35d-415e-a184-8b4a46396a07" status: 202 len: 0 microversion: 2.1 time: 0.165464 Apr 13 19:09:48 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 189/558] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:09:47 2023] DELETE /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b/os-volume_attachments/3d1dd6ab-d35d-415e-a184-8b4a46396a07 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:09:48 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-66e41f67-c313-465b-a531-a3f54d52104c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:09:48 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-66e41f67-c313-465b-a531-a3f54d52104c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:09:48 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66e41f67-c313-465b-a531-a3f54d52104c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:48 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66e41f67-c313-465b-a531-a3f54d52104c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:48 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66e41f67-c313-465b-a531-a3f54d52104c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:48 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66e41f67-c313-465b-a531-a3f54d52104c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:48 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66e41f67-c313-465b-a531-a3f54d52104c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:48 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-66e41f67-c313-465b-a531-a3f54d52104c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:48 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-66e41f67-c313-465b-a531-a3f54d52104c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049263 Apr 13 19:09:48 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 185/559] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:09:48 2023] GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:09:48 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-a66058b0-facd-47bd-a3b8-ed2c14acb472 req-db83a8c5-6d47-4238-9f89-4500a0bd25d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2e4899-d6d5-422c-a4f1-61a8129abdae", "name": "network-vif-plugged", "status": "completed", "tag": "071fd8c9-9400-42aa-ad88-1176bb1d4910"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:09:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-a66058b0-facd-47bd-a3b8-ed2c14acb472 req-db83a8c5-6d47-4238-9f89-4500a0bd25d6 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:09:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-a66058b0-facd-47bd-a3b8-ed2c14acb472 req-db83a8c5-6d47-4238-9f89-4500a0bd25d6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:09:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-a66058b0-facd-47bd-a3b8-ed2c14acb472 req-db83a8c5-6d47-4238-9f89-4500a0bd25d6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:09:48 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-a66058b0-facd-47bd-a3b8-ed2c14acb472 req-db83a8c5-6d47-4238-9f89-4500a0bd25d6 service nova] Creating event network-vif-plugged:071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae on user Apr 13 19:09:48 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-a66058b0-facd-47bd-a3b8-ed2c14acb472 req-db83a8c5-6d47-4238-9f89-4500a0bd25d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028497 Apr 13 19:09:48 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 186/560] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:09:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:01 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=5 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:01 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-95392e74-6f46-4c3c-b3ec-6a0df518b170 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:01 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-95392e74-6f46-4c3c-b3ec-6a0df518b170 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-95392e74-6f46-4c3c-b3ec-6a0df518b170 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-95392e74-6f46-4c3c-b3ec-6a0df518b170 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-95392e74-6f46-4c3c-b3ec-6a0df518b170 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-95392e74-6f46-4c3c-b3ec-6a0df518b170 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-95392e74-6f46-4c3c-b3ec-6a0df518b170 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-95392e74-6f46-4c3c-b3ec-6a0df518b170 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-95392e74-6f46-4c3c-b3ec-6a0df518b170 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] HTTP exception thrown: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-95392e74-6f46-4c3c-b3ec-6a0df518b170 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Request method failure captured: Apr 13 19:10:01 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 HTTP/1.1 Apr 13 19:10:01 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:10:01 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:10:01 user devstack@n-api.service[61587]: Connection: close Apr 13 19:10:01 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:10:01 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:10:01 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:10:01 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:10:01 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBb38ENjgIANqdrX7XrmIMzqcpj_okvZw1mB-TG9-fRWgfosgoAwN6GZu8vJvfLgQWGRDz3YB7_43sKitPC16qn1TDoymQGkMP95CyOcJ3JUksqrQaOV-lIo9FQY5U4p5cZ1G7ekMKMQ1e7NmTOnpkl2UbMh_70ALxLFTV1D8zJTR8 Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Project-Id: 63b52d6508154a918a13b31712b32796 Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Project-Name: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b52d6508154a918a13b31712b32796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63b52d6508154a918a13b31712b32796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b52d6508154a918a13b31712b32796"}]}] Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Tenant: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Tenant-Id: 63b52d6508154a918a13b31712b32796 Apr 13 19:10:01 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:01 user devstack@n-api.service[61587]: X-User: tempest-AttachVolumeTestJSON-43043273-project-member Apr 13 19:10:01 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:10:01 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:10:01 user devstack@n-api.service[61587]: X-User-Id: ba70f34af8664dc89fd9851d00d5b96d Apr 13 19:10:01 user devstack@n-api.service[61587]: X-User-Name: tempest-AttachVolumeTestJSON-43043273-project-member Apr 13 19:10:01 user devstack@n-api.service[61587]: method: > Apr 13 19:10:01 user devstack@n-api.service[61587]: exception: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:01 user devstack@n-api.service[61587]: action_args: {'id': 'ee71fe6c-33cc-45aa-b1b7-2d266fa59b04'} Apr 13 19:10:01 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-95392e74-6f46-4c3c-b3ec-6a0df518b170 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Returning 404 to user: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:10:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-95392e74-6f46-4c3c-b3ec-6a0df518b170 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" status: 404 len: 111 microversion: 2.1 time: 0.038043 Apr 13 19:10:01 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 190/561] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:10:01 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:10:01 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-77f49df4-ada2-4673-853c-1911116ba268 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '.version_select at 0x7efe33e10c10>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:01 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=7 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:01 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=22 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:01 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-77f49df4-ada2-4673-853c-1911116ba268 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-293682674" status: 202 len: 0 microversion: 2.1 time: 0.029375 Apr 13 19:10:01 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 186/562] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 19:10:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-293682674 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:10:05 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:05 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-6eab0d56-a5d1-429a-8121-ab4b72f7ab3d tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:05 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-6eab0d56-a5d1-429a-8121-ab4b72f7ab3d tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6eab0d56-a5d1-429a-8121-ab4b72f7ab3d tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6eab0d56-a5d1-429a-8121-ab4b72f7ab3d tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6eab0d56-a5d1-429a-8121-ab4b72f7ab3d tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6eab0d56-a5d1-429a-8121-ab4b72f7ab3d tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6eab0d56-a5d1-429a-8121-ab4b72f7ab3d tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6eab0d56-a5d1-429a-8121-ab4b72f7ab3d tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:05 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-6eab0d56-a5d1-429a-8121-ab4b72f7ab3d tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44f04fabef14935a4617dd452d3999b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8fe614f0541009788ffe685720634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:10:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-6eab0d56-a5d1-429a-8121-ab4b72f7ab3d tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" status: 200 len: 1495 microversion: 2.1 time: 0.163325 Apr 13 19:10:05 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 187/563] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:10:05 2023] GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => generated 1495 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:10:07 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-053763ab-12de-4a89-994f-3e7de043d212 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:07 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-053763ab-12de-4a89-994f-3e7de043d212 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-053763ab-12de-4a89-994f-3e7de043d212 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-053763ab-12de-4a89-994f-3e7de043d212 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-053763ab-12de-4a89-994f-3e7de043d212 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-053763ab-12de-4a89-994f-3e7de043d212 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-053763ab-12de-4a89-994f-3e7de043d212 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-053763ab-12de-4a89-994f-3e7de043d212 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:07 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-053763ab-12de-4a89-994f-3e7de043d212 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] HTTP exception thrown: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:07 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-053763ab-12de-4a89-994f-3e7de043d212 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Request method failure captured: Apr 13 19:10:07 user devstack@n-api.service[61587]: request: DELETE /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 HTTP/1.1 Apr 13 19:10:07 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:10:07 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:10:07 user devstack@n-api.service[61587]: Connection: close Apr 13 19:10:07 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:10:07 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:10:07 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:10:07 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:10:07 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBb38ENjgIANqdrX7XrmIMzqcpj_okvZw1mB-TG9-fRWgfosgoAwN6GZu8vJvfLgQWGRDz3YB7_43sKitPC16qn1TDoymQGkMP95CyOcJ3JUksqrQaOV-lIo9FQY5U4p5cZ1G7ekMKMQ1e7NmTOnpkl2UbMh_70ALxLFTV1D8zJTR8 Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Project-Id: 63b52d6508154a918a13b31712b32796 Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Project-Name: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b52d6508154a918a13b31712b32796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63b52d6508154a918a13b31712b32796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b52d6508154a918a13b31712b32796"}]}] Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Tenant: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Tenant-Id: 63b52d6508154a918a13b31712b32796 Apr 13 19:10:07 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:07 user devstack@n-api.service[61587]: X-User: tempest-AttachVolumeTestJSON-43043273-project-member Apr 13 19:10:07 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:10:07 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:10:07 user devstack@n-api.service[61587]: X-User-Id: ba70f34af8664dc89fd9851d00d5b96d Apr 13 19:10:07 user devstack@n-api.service[61587]: X-User-Name: tempest-AttachVolumeTestJSON-43043273-project-member Apr 13 19:10:07 user devstack@n-api.service[61587]: method: > Apr 13 19:10:07 user devstack@n-api.service[61587]: exception: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:07 user devstack@n-api.service[61587]: action_args: {'id': 'ee71fe6c-33cc-45aa-b1b7-2d266fa59b04'} Apr 13 19:10:07 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:07 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-053763ab-12de-4a89-994f-3e7de043d212 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Returning 404 to user: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:10:07 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-053763ab-12de-4a89-994f-3e7de043d212 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" status: 404 len: 111 microversion: 2.1 time: 0.031949 Apr 13 19:10:07 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 191/564] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:10:06 2023] DELETE /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:10:07 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-46c92079-396f-450d-9da9-b92f1208254c tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:07 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-46c92079-396f-450d-9da9-b92f1208254c tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-46c92079-396f-450d-9da9-b92f1208254c tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-46c92079-396f-450d-9da9-b92f1208254c tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-46c92079-396f-450d-9da9-b92f1208254c tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-46c92079-396f-450d-9da9-b92f1208254c tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-46c92079-396f-450d-9da9-b92f1208254c tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-46c92079-396f-450d-9da9-b92f1208254c tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:07 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-46c92079-396f-450d-9da9-b92f1208254c tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] HTTP exception thrown: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:07 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-46c92079-396f-450d-9da9-b92f1208254c tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Request method failure captured: Apr 13 19:10:07 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 HTTP/1.1 Apr 13 19:10:07 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:10:07 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:10:07 user devstack@n-api.service[61589]: Connection: close Apr 13 19:10:07 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:10:07 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:10:07 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:10:07 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:10:07 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBb38ENjgIANqdrX7XrmIMzqcpj_okvZw1mB-TG9-fRWgfosgoAwN6GZu8vJvfLgQWGRDz3YB7_43sKitPC16qn1TDoymQGkMP95CyOcJ3JUksqrQaOV-lIo9FQY5U4p5cZ1G7ekMKMQ1e7NmTOnpkl2UbMh_70ALxLFTV1D8zJTR8 Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Project-Id: 63b52d6508154a918a13b31712b32796 Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Project-Name: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b52d6508154a918a13b31712b32796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63b52d6508154a918a13b31712b32796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b52d6508154a918a13b31712b32796"}]}] Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Tenant: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Tenant-Id: 63b52d6508154a918a13b31712b32796 Apr 13 19:10:07 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:07 user devstack@n-api.service[61589]: X-User: tempest-AttachVolumeTestJSON-43043273-project-member Apr 13 19:10:07 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:10:07 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:10:07 user devstack@n-api.service[61589]: X-User-Id: ba70f34af8664dc89fd9851d00d5b96d Apr 13 19:10:07 user devstack@n-api.service[61589]: X-User-Name: tempest-AttachVolumeTestJSON-43043273-project-member Apr 13 19:10:07 user devstack@n-api.service[61589]: method: > Apr 13 19:10:07 user devstack@n-api.service[61589]: exception: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:07 user devstack@n-api.service[61589]: action_args: {'id': 'ee71fe6c-33cc-45aa-b1b7-2d266fa59b04'} Apr 13 19:10:07 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. Apr 13 19:10:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:07 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-46c92079-396f-450d-9da9-b92f1208254c tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Returning 404 to user: Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:10:07 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-46c92079-396f-450d-9da9-b92f1208254c tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" status: 404 len: 111 microversion: 2.1 time: 0.030110 Apr 13 19:10:07 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 187/565] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:10:07 2023] GET /compute/v2.1/servers/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:10:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-855711ba-e784-4e43-96fa-9e63c6031562 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:09 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-855711ba-e784-4e43-96fa-9e63c6031562 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-855711ba-e784-4e43-96fa-9e63c6031562 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-855711ba-e784-4e43-96fa-9e63c6031562 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-855711ba-e784-4e43-96fa-9e63c6031562 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-855711ba-e784-4e43-96fa-9e63c6031562 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-855711ba-e784-4e43-96fa-9e63c6031562 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-855711ba-e784-4e43-96fa-9e63c6031562 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-855711ba-e784-4e43-96fa-9e63c6031562 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] HTTP exception thrown: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:10:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-855711ba-e784-4e43-96fa-9e63c6031562 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Request method failure captured: Apr 13 19:10:09 user devstack@n-api.service[61588]: request: DELETE /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 HTTP/1.1 Apr 13 19:10:09 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:10:09 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:10:09 user devstack@n-api.service[61588]: Connection: close Apr 13 19:10:09 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:10:09 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:10:09 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:10:09 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:10:09 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBb38ENjgIANqdrX7XrmIMzqcpj_okvZw1mB-TG9-fRWgfosgoAwN6GZu8vJvfLgQWGRDz3YB7_43sKitPC16qn1TDoymQGkMP95CyOcJ3JUksqrQaOV-lIo9FQY5U4p5cZ1G7ekMKMQ1e7NmTOnpkl2UbMh_70ALxLFTV1D8zJTR8 Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Project-Id: 63b52d6508154a918a13b31712b32796 Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Project-Name: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b52d6508154a918a13b31712b32796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63b52d6508154a918a13b31712b32796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b52d6508154a918a13b31712b32796"}]}] Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Tenant: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Tenant-Id: 63b52d6508154a918a13b31712b32796 Apr 13 19:10:09 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:09 user devstack@n-api.service[61588]: X-User: tempest-AttachVolumeTestJSON-43043273-project-member Apr 13 19:10:09 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:10:09 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:10:09 user devstack@n-api.service[61588]: X-User-Id: ba70f34af8664dc89fd9851d00d5b96d Apr 13 19:10:09 user devstack@n-api.service[61588]: X-User-Name: tempest-AttachVolumeTestJSON-43043273-project-member Apr 13 19:10:09 user devstack@n-api.service[61588]: method: > Apr 13 19:10:09 user devstack@n-api.service[61588]: exception: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:10:09 user devstack@n-api.service[61588]: action_args: {'id': 'a15c1b5e-1769-490a-b81f-09333cd4a227'} Apr 13 19:10:09 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:10:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:10:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-855711ba-e784-4e43-96fa-9e63c6031562 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Returning 404 to user: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:10:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-855711ba-e784-4e43-96fa-9e63c6031562 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 404 len: 111 microversion: 2.1 time: 0.045806 Apr 13 19:10:09 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 188/566] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:10:09 2023] DELETE /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:10:09 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c2203a5b-5944-4d5c-8b66-964c55355f7b tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:09 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-c2203a5b-5944-4d5c-8b66-964c55355f7b tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c2203a5b-5944-4d5c-8b66-964c55355f7b tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c2203a5b-5944-4d5c-8b66-964c55355f7b tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c2203a5b-5944-4d5c-8b66-964c55355f7b tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c2203a5b-5944-4d5c-8b66-964c55355f7b tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c2203a5b-5944-4d5c-8b66-964c55355f7b tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c2203a5b-5944-4d5c-8b66-964c55355f7b tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:09 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-c2203a5b-5944-4d5c-8b66-964c55355f7b tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] HTTP exception thrown: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:10:09 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c2203a5b-5944-4d5c-8b66-964c55355f7b tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Request method failure captured: Apr 13 19:10:09 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 HTTP/1.1 Apr 13 19:10:09 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:10:09 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:10:09 user devstack@n-api.service[61587]: Connection: close Apr 13 19:10:09 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:10:09 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:10:09 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:10:09 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:10:09 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBb38ENjgIANqdrX7XrmIMzqcpj_okvZw1mB-TG9-fRWgfosgoAwN6GZu8vJvfLgQWGRDz3YB7_43sKitPC16qn1TDoymQGkMP95CyOcJ3JUksqrQaOV-lIo9FQY5U4p5cZ1G7ekMKMQ1e7NmTOnpkl2UbMh_70ALxLFTV1D8zJTR8 Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Project-Id: 63b52d6508154a918a13b31712b32796 Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Project-Name: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b52d6508154a918a13b31712b32796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/63b52d6508154a918a13b31712b32796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/63b52d6508154a918a13b31712b32796"}]}] Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Tenant: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Tenant-Id: 63b52d6508154a918a13b31712b32796 Apr 13 19:10:09 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-43043273 Apr 13 19:10:09 user devstack@n-api.service[61587]: X-User: tempest-AttachVolumeTestJSON-43043273-project-member Apr 13 19:10:09 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:10:09 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:10:09 user devstack@n-api.service[61587]: X-User-Id: ba70f34af8664dc89fd9851d00d5b96d Apr 13 19:10:09 user devstack@n-api.service[61587]: X-User-Name: tempest-AttachVolumeTestJSON-43043273-project-member Apr 13 19:10:09 user devstack@n-api.service[61587]: method: > Apr 13 19:10:09 user devstack@n-api.service[61587]: exception: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:10:09 user devstack@n-api.service[61587]: action_args: {'id': 'a15c1b5e-1769-490a-b81f-09333cd4a227'} Apr 13 19:10:09 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. Apr 13 19:10:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:09 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c2203a5b-5944-4d5c-8b66-964c55355f7b tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Returning 404 to user: Instance a15c1b5e-1769-490a-b81f-09333cd4a227 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:10:09 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-c2203a5b-5944-4d5c-8b66-964c55355f7b tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227" status: 404 len: 111 microversion: 2.1 time: 0.027120 Apr 13 19:10:09 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 192/567] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:10:09 2023] GET /compute/v2.1/servers/a15c1b5e-1769-490a-b81f-09333cd4a227 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:10:13 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8a79351a-5f94-4509-af61-4d8beedfd141 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] Action: 'create', calling method: .version_select at 0x7efe33eee050>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-858650699", "metadata": {"Type": "work"}}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:13 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-8a79351a-5f94-4509-af61-4d8beedfd141 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.471382 Apr 13 19:10:13 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 188/568] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 19:10:13 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 473 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 19:10:13 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-38a75ba1-b420-49d2-bb7d-d3f34571e535 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] Calling method '.version_select at 0x7efe33fa8670>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:13 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-38a75ba1-b420-49d2-bb7d-d3f34571e535 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671" status: 200 len: 352 microversion: 2.1 time: 0.059256 Apr 13 19:10:13 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 189/569] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 19:10:13 2023] GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:14 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e21821fb-50e2-43fc-8c3f-4ee76f8f30fd tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] Calling method '.version_select at 0x7efe33d9dea0>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:14 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e21821fb-50e2-43fc-8c3f-4ee76f8f30fd tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671" status: 200 len: 353 microversion: 2.1 time: 0.057666 Apr 13 19:10:14 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 193/570] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 19:10:14 2023] GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:14 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8810c36f-bb2f-4a37-b2d6-079b3ca7e09c tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] Calling method '.version_select at 0x7efe33d5ea70>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:14 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-8810c36f-bb2f-4a37-b2d6-079b3ca7e09c tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671" status: 200 len: 353 microversion: 2.1 time: 0.053007 Apr 13 19:10:14 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 189/571] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 19:10:14 2023] GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:14 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0101d00b-aff6-4432-bcea-b16a56f06710 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] Calling method '.version_select at 0x7efe33fcf760>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-0101d00b-aff6-4432-bcea-b16a56f06710 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671" status: 202 len: 0 microversion: 2.1 time: 0.061963 Apr 13 19:10:14 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 190/572] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 19:10:14 2023] DELETE /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:10:14 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3d3cd6d2-a41f-47ee-af3e-46794de8a0ce tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] Calling method '.version_select at 0x7efe33f55750>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-3d3cd6d2-a41f-47ee-af3e-46794de8a0ce tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671" status: 200 len: 352 microversion: 2.1 time: 0.051605 Apr 13 19:10:15 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 194/573] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 19:10:14 2023] GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:16 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fd7d69bd-ae53-4750-bf9b-b196230108a6 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] Calling method '.version_select at 0x7efe33eecee0>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-fd7d69bd-ae53-4750-bf9b-b196230108a6 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671" status: 200 len: 352 microversion: 2.1 time: 0.049305 Apr 13 19:10:16 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 190/574] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 19:10:16 2023] GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:16 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:16 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:17 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:10:17 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-69e5d677-6cd7-49a4-987b-c71a8141ed2d tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] Calling method '.version_select at 0x7efe38f94ca0>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:17 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 204 len: 0 microversion: 2.1 time: 0.115345 Apr 13 19:10:17 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 191/575] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:10:16 2023] DELETE /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:10:17 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:17 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:17 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-10135f0a-0ccb-48e6-b9e7-32340db76b8c tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:17 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-10135f0a-0ccb-48e6-b9e7-32340db76b8c tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:17 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-10135f0a-0ccb-48e6-b9e7-32340db76b8c tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:17 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-10135f0a-0ccb-48e6-b9e7-32340db76b8c tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:17 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-10135f0a-0ccb-48e6-b9e7-32340db76b8c tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:17 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-10135f0a-0ccb-48e6-b9e7-32340db76b8c tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:17 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-10135f0a-0ccb-48e6-b9e7-32340db76b8c tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:17 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-10135f0a-0ccb-48e6-b9e7-32340db76b8c tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:17 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-69e5d677-6cd7-49a4-987b-c71a8141ed2d tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671" status: 200 len: 352 microversion: 2.1 time: 0.056374 Apr 13 19:10:17 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 195/576] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 19:10:17 2023] GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:17 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-10135f0a-0ccb-48e6-b9e7-32340db76b8c tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:10:17 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-10135f0a-0ccb-48e6-b9e7-32340db76b8c tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 200 len: 1726 microversion: 2.1 time: 0.207303 Apr 13 19:10:17 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 191/577] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:10:17 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 1726 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:10:17 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-7e31c3d4-7f26-4be2-b200-cc1f9c4583e7 req-2f0a5665-88c6-4f1c-ab68-3e9fdf798dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-unplugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7e31c3d4-7f26-4be2-b200-cc1f9c4583e7 req-2f0a5665-88c6-4f1c-ab68-3e9fdf798dd8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7e31c3d4-7f26-4be2-b200-cc1f9c4583e7 req-2f0a5665-88c6-4f1c-ab68-3e9fdf798dd8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7e31c3d4-7f26-4be2-b200-cc1f9c4583e7 req-2f0a5665-88c6-4f1c-ab68-3e9fdf798dd8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:17 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-7e31c3d4-7f26-4be2-b200-cc1f9c4583e7 req-2f0a5665-88c6-4f1c-ab68-3e9fdf798dd8 service nova] Creating event network-vif-unplugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:10:17 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-7e31c3d4-7f26-4be2-b200-cc1f9c4583e7 req-2f0a5665-88c6-4f1c-ab68-3e9fdf798dd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032295 Apr 13 19:10:17 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 192/578] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:10:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:18 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ee766fdd-39d9-4029-bb6b-61cfa99b7867 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] Calling method '.version_select at 0x7efe33d9dea0>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:18 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-ee766fdd-39d9-4029-bb6b-61cfa99b7867 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] HTTP exception thrown: Volume 92df0fac-b1ff-4614-990f-9bf67eeb2671 could not be found. Apr 13 19:10:18 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ee766fdd-39d9-4029-bb6b-61cfa99b7867 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] Request method failure captured: Apr 13 19:10:18 user devstack@n-api.service[61587]: request: GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671 HTTP/1.1 Apr 13 19:10:18 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:10:18 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:10:18 user devstack@n-api.service[61587]: Connection: close Apr 13 19:10:18 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:10:18 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:10:18 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:10:18 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:10:18 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFOVLKezvvmJgrmB9z6JpEAPWlXJGcOvRPXA3ZqQ6ujYTBljQXr277vYk_i9dvxxmekAt9PvYMp0XuSUcRGhFx26zr93HRujql7BPHDCRhj3iT9RcuDYmzmZXXj-NqocJ368t-w_YsGbQLOABIK-VF_mwLcKMrP8hYLQz1-CSLCzEfQ Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Project-Id: 265d668dcb6d4c38960032986a2ccc25 Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Project-Name: tempest-VolumesGetTestJSON-1931600895 Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/265d668dcb6d4c38960032986a2ccc25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/265d668dcb6d4c38960032986a2ccc25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/265d668dcb6d4c38960032986a2ccc25"}]}] Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Tenant: tempest-VolumesGetTestJSON-1931600895 Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Tenant-Id: 265d668dcb6d4c38960032986a2ccc25 Apr 13 19:10:18 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-VolumesGetTestJSON-1931600895 Apr 13 19:10:18 user devstack@n-api.service[61587]: X-User: tempest-VolumesGetTestJSON-1931600895-project-member Apr 13 19:10:18 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:10:18 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:10:18 user devstack@n-api.service[61587]: X-User-Id: 1de3f56fbbdc4dab96bd9f53f0f004c2 Apr 13 19:10:18 user devstack@n-api.service[61587]: X-User-Name: tempest-VolumesGetTestJSON-1931600895-project-member Apr 13 19:10:18 user devstack@n-api.service[61587]: method: Apr 13 19:10:18 user devstack@n-api.service[61587]: exception: Volume 92df0fac-b1ff-4614-990f-9bf67eeb2671 could not be found. Apr 13 19:10:18 user devstack@n-api.service[61587]: action_args: {'id': '92df0fac-b1ff-4614-990f-9bf67eeb2671'} Apr 13 19:10:18 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92df0fac-b1ff-4614-990f-9bf67eeb2671 could not be found. (HTTP 404) (Request-ID: req-7c693ff0-898f-407f-979f-71cae7300546) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92df0fac-b1ff-4614-990f-9bf67eeb2671 could not be found. Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92df0fac-b1ff-4614-990f-9bf67eeb2671 could not be found. Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92df0fac-b1ff-4614-990f-9bf67eeb2671 could not be found. Apr 13 19:10:18 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:18 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ee766fdd-39d9-4029-bb6b-61cfa99b7867 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] Returning 404 to user: Volume 92df0fac-b1ff-4614-990f-9bf67eeb2671 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:10:18 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-ee766fdd-39d9-4029-bb6b-61cfa99b7867 tempest-VolumesGetTestJSON-1931600895 tempest-VolumesGetTestJSON-1931600895-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671" status: 404 len: 109 microversion: 2.1 time: 0.039506 Apr 13 19:10:18 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 196/579] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 19:10:18 2023] GET /compute/v2.1/os-volumes/92df0fac-b1ff-4614-990f-9bf67eeb2671 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:10:18 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-5ad31822-112f-445d-9f38-b0ceedd732dd tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:18 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-5ad31822-112f-445d-9f38-b0ceedd732dd tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5ad31822-112f-445d-9f38-b0ceedd732dd tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5ad31822-112f-445d-9f38-b0ceedd732dd tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5ad31822-112f-445d-9f38-b0ceedd732dd tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5ad31822-112f-445d-9f38-b0ceedd732dd tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5ad31822-112f-445d-9f38-b0ceedd732dd tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5ad31822-112f-445d-9f38-b0ceedd732dd tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:18 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-5ad31822-112f-445d-9f38-b0ceedd732dd tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9282b733244da9bf210ddc66b74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1ef6e7b159468f90cfc0db2e8e904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:10:18 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-5ad31822-112f-445d-9f38-b0ceedd732dd tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d" status: 200 len: 1552 microversion: 2.1 time: 0.160281 Apr 13 19:10:18 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 192/580] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:10:18 2023] GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:10:19 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-9f0ae740-2c76-4f76-8483-a2b2f93f25bf req-12f0a1b7-bcc4-4e37-a5b2-d469d7b813d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-deleted", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-9f0ae740-2c76-4f76-8483-a2b2f93f25bf req-12f0a1b7-bcc4-4e37-a5b2-d469d7b813d8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-9f0ae740-2c76-4f76-8483-a2b2f93f25bf req-12f0a1b7-bcc4-4e37-a5b2-d469d7b813d8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-9f0ae740-2c76-4f76-8483-a2b2f93f25bf req-12f0a1b7-bcc4-4e37-a5b2-d469d7b813d8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:19 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-9f0ae740-2c76-4f76-8483-a2b2f93f25bf req-12f0a1b7-bcc4-4e37-a5b2-d469d7b813d8 service nova] Creating event network-vif-deleted:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:10:19 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-9f0ae740-2c76-4f76-8483-a2b2f93f25bf req-12f0a1b7-bcc4-4e37-a5b2-d469d7b813d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029046 Apr 13 19:10:19 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 193/581] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:10:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:19 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:19 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-433dce35-7dde-4ebc-b904-763e5277b7ee req-29ffa09b-5f63-41de-a368-6e9cdeb7f2fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b297ca1-e672-438a-917a-df2319262bc0"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-433dce35-7dde-4ebc-b904-763e5277b7ee req-29ffa09b-5f63-41de-a368-6e9cdeb7f2fc service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-433dce35-7dde-4ebc-b904-763e5277b7ee req-29ffa09b-5f63-41de-a368-6e9cdeb7f2fc service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-433dce35-7dde-4ebc-b904-763e5277b7ee req-29ffa09b-5f63-41de-a368-6e9cdeb7f2fc service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:20 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-433dce35-7dde-4ebc-b904-763e5277b7ee req-29ffa09b-5f63-41de-a368-6e9cdeb7f2fc service nova] Creating event network-vif-plugged:2b297ca1-e672-438a-917a-df2319262bc0 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 on user Apr 13 19:10:20 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-433dce35-7dde-4ebc-b904-763e5277b7ee req-29ffa09b-5f63-41de-a368-6e9cdeb7f2fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032204 Apr 13 19:10:20 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 197/582] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:10:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fb311148-a953-4a7e-8a6f-de59815bdf5d tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90cc5bb9-95aa-434d-b6a4-b70149c2ee31"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:25 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-fb311148-a953-4a7e-8a6f-de59815bdf5d tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fb311148-a953-4a7e-8a6f-de59815bdf5d tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fb311148-a953-4a7e-8a6f-de59815bdf5d tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fb311148-a953-4a7e-8a6f-de59815bdf5d tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fb311148-a953-4a7e-8a6f-de59815bdf5d tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fb311148-a953-4a7e-8a6f-de59815bdf5d tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fb311148-a953-4a7e-8a6f-de59815bdf5d tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-fb311148-a953-4a7e-8a6f-de59815bdf5d tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f while it is in vm_state rescued Apr 13 19:10:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fb311148-a953-4a7e-8a6f-de59815bdf5d tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Request method failure captured: Apr 13 19:10:25 user devstack@n-api.service[61589]: request: POST /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/os-volume_attachments HTTP/1.1 Apr 13 19:10:25 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:10:25 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:10:25 user devstack@n-api.service[61589]: Connection: close Apr 13 19:10:25 user devstack@n-api.service[61589]: Content-Length: 74 Apr 13 19:10:25 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:10:25 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:10:25 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:10:25 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFIW5I_A2oi7_fnWAXup5bR_1v4_NxI2GY1J1uY5nA0Rpx18iBmtG3f0vrXqcApPhKfHUi1pI15fOYoO4JzcqVLkugFjbCLEnhTIfLFsB4wc3App5vw0u0L75IqNFxG2VAhF9UVebRhkjPsHR1_2ogh-T-bEdLq7RR3AuJbhokeecMs Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Project-Id: 42fbd7089a7e4ba8b2597fca0d8e84c8 Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}] Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Tenant-Id: 42fbd7089a7e4ba8b2597fca0d8e84c8 Apr 13 19:10:25 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:10:25 user devstack@n-api.service[61589]: X-User: tempest-ServerRescueNegativeTestJSON-1255770111-project-member Apr 13 19:10:25 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:10:25 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:10:25 user devstack@n-api.service[61589]: X-User-Id: 3bebf61a7401492692f9c60adde178f7 Apr 13 19:10:25 user devstack@n-api.service[61589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255770111-project-member Apr 13 19:10:25 user devstack@n-api.service[61589]: Apr 13 19:10:25 user devstack@n-api.service[61589]: {"volumeAttachment": {"volumeId": "90cc5bb9-95aa-434d-b6a4-b70149c2ee31"}} Apr 13 19:10:25 user devstack@n-api.service[61589]: method: > Apr 13 19:10:25 user devstack@n-api.service[61589]: exception: Cannot 'attach_volume' instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f while it is in vm_state rescued Apr 13 19:10:25 user devstack@n-api.service[61589]: action_args: {'server_id': '29eeca99-f237-49d9-9c7d-5c5b7ff2892f', 'body': {'volumeAttachment': {'volumeId': '90cc5bb9-95aa-434d-b6a4-b70149c2ee31'}}} Apr 13 19:10:25 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f while it is in vm_state rescued Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f while it is in vm_state rescued Apr 13 19:10:25 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fb311148-a953-4a7e-8a6f-de59815bdf5d tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Returning 409 to user: Cannot 'attach_volume' instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f while it is in vm_state rescued {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:10:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-fb311148-a953-4a7e-8a6f-de59815bdf5d tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "POST /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059644 Apr 13 19:10:25 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 193/583] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:10:25 2023] POST /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/os-volume_attachments => generated 152 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 13 19:10:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:25 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "POST /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/action" status: 202 len: 0 microversion: 2.1 time: 0.100003 Apr 13 19:10:25 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 194/584] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:10:25 2023] POST /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:10:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-5aea0e08-9954-4c6b-a0e5-f6a8a5e22635 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:25 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-5aea0e08-9954-4c6b-a0e5-f6a8a5e22635 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5aea0e08-9954-4c6b-a0e5-f6a8a5e22635 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5aea0e08-9954-4c6b-a0e5-f6a8a5e22635 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5aea0e08-9954-4c6b-a0e5-f6a8a5e22635 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5aea0e08-9954-4c6b-a0e5-f6a8a5e22635 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5aea0e08-9954-4c6b-a0e5-f6a8a5e22635 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5aea0e08-9954-4c6b-a0e5-f6a8a5e22635 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:25 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-5aea0e08-9954-4c6b-a0e5-f6a8a5e22635 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:10:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-5aea0e08-9954-4c6b-a0e5-f6a8a5e22635 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f" status: 200 len: 1497 microversion: 2.1 time: 0.198545 Apr 13 19:10:25 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 198/585] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:10:25 2023] GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:10:26 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-b4cae10e-9d35-4fc3-a637-d25bc2b435c8 req-8bf662a7-0cdd-4d8f-83ca-54c0767ddb92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-unplugged", "status": "completed", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:26 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b4cae10e-9d35-4fc3-a637-d25bc2b435c8 req-8bf662a7-0cdd-4d8f-83ca-54c0767ddb92 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:26 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b4cae10e-9d35-4fc3-a637-d25bc2b435c8 req-8bf662a7-0cdd-4d8f-83ca-54c0767ddb92 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:26 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b4cae10e-9d35-4fc3-a637-d25bc2b435c8 req-8bf662a7-0cdd-4d8f-83ca-54c0767ddb92 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:26 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-b4cae10e-9d35-4fc3-a637-d25bc2b435c8 req-8bf662a7-0cdd-4d8f-83ca-54c0767ddb92 service nova] Creating event network-vif-unplugged:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:10:26 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-b4cae10e-9d35-4fc3-a637-d25bc2b435c8 req-8bf662a7-0cdd-4d8f-83ca-54c0767ddb92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032104 Apr 13 19:10:26 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 194/586] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:10:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-plugged", "status": "completed", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}, {"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-plugged", "status": "completed", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] Creating event network-vif-plugged:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:10:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] Creating event network-vif-plugged:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:10:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031019 Apr 13 19:10:28 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 195/587] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:10:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:30 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-6a12f3d6-f627-4d3c-bf37-3aa670b94ff1 req-b3187024-34a5-42e5-873d-d34e89e73e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-plugged", "status": "completed", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:30 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6a12f3d6-f627-4d3c-bf37-3aa670b94ff1 req-b3187024-34a5-42e5-873d-d34e89e73e60 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:30 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6a12f3d6-f627-4d3c-bf37-3aa670b94ff1 req-b3187024-34a5-42e5-873d-d34e89e73e60 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:30 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6a12f3d6-f627-4d3c-bf37-3aa670b94ff1 req-b3187024-34a5-42e5-873d-d34e89e73e60 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:30 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-6a12f3d6-f627-4d3c-bf37-3aa670b94ff1 req-b3187024-34a5-42e5-873d-d34e89e73e60 service nova] Creating event network-vif-plugged:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:10:30 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-6a12f3d6-f627-4d3c-bf37-3aa670b94ff1 req-b3187024-34a5-42e5-873d-d34e89e73e60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041983 Apr 13 19:10:30 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 199/588] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:10:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:36 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7d05f7eb-c5e3-48b5-92a4-3f002229cdd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:36 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-7d05f7eb-c5e3-48b5-92a4-3f002229cdd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:36 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=8 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:36 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=18 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7d05f7eb-c5e3-48b5-92a4-3f002229cdd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7d05f7eb-c5e3-48b5-92a4-3f002229cdd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7d05f7eb-c5e3-48b5-92a4-3f002229cdd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7d05f7eb-c5e3-48b5-92a4-3f002229cdd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7d05f7eb-c5e3-48b5-92a4-3f002229cdd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7d05f7eb-c5e3-48b5-92a4-3f002229cdd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:36 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-7d05f7eb-c5e3-48b5-92a4-3f002229cdd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] HTTP exception thrown: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:36 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7d05f7eb-c5e3-48b5-92a4-3f002229cdd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Request method failure captured: Apr 13 19:10:36 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae HTTP/1.1 Apr 13 19:10:36 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:10:36 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:10:36 user devstack@n-api.service[61589]: Connection: close Apr 13 19:10:36 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:10:36 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:10:36 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:10:36 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:10:36 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBklJWjujPp7_H2HyeXYwZV1Iyrbv0W_02hOgzZjJJa8Le36FOcl4nlEQ0OEaAHNMIkFNxhBLn_fFHQ41HweFRR9363GgB8bfDFQ6_bzBzTrNMLnQfkW2o5hfOos_zLtVE2MNRXKdsHe_6rHCrIpZt9oegglM1s6bbnyShXflzrk8A Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Project-Id: faabdcc8e61c452ab3b934b1c9501e68 Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faabdcc8e61c452ab3b934b1c9501e68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/faabdcc8e61c452ab3b934b1c9501e68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faabdcc8e61c452ab3b934b1c9501e68"}]}] Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Tenant-Id: faabdcc8e61c452ab3b934b1c9501e68 Apr 13 19:10:36 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:36 user devstack@n-api.service[61589]: X-User: tempest-AttachVolumeShelveTestJSON-1546308967-project-member Apr 13 19:10:36 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:10:36 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:10:36 user devstack@n-api.service[61589]: X-User-Id: ee6c76c605d54b4f84e0596b27087f0b Apr 13 19:10:36 user devstack@n-api.service[61589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1546308967-project-member Apr 13 19:10:36 user devstack@n-api.service[61589]: method: > Apr 13 19:10:36 user devstack@n-api.service[61589]: exception: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:36 user devstack@n-api.service[61589]: action_args: {'id': '2c2e4899-d6d5-422c-a4f1-61a8129abdae'} Apr 13 19:10:36 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:36 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:36 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7d05f7eb-c5e3-48b5-92a4-3f002229cdd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Returning 404 to user: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:10:36 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7d05f7eb-c5e3-48b5-92a4-3f002229cdd3 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae" status: 404 len: 111 microversion: 2.20 time: 0.040710 Apr 13 19:10:36 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 195/589] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:10:36 2023] GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:10:36 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-58a91e8b-f67a-494f-ba2a-f160aa8bc4f1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '.version_select at 0x7efe33fcd090>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:36 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:36 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-58a91e8b-f67a-494f-ba2a-f160aa8bc4f1 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280930280" status: 204 len: 0 microversion: 2.20 time: 0.022347 Apr 13 19:10:36 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 196/590] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 19:10:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280930280 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-444502434", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "b34bf81f-6825-4376-a26c-35386631a4ad"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] validate_networks() for [('b34bf81f-6825-4376-a26c-35386631a4ad', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Getting quotas for project 2877676ccbd0484d80ecabf3030c0ee4. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Getting quotas for user 80063ed703d24a1b84aede724db205a7 and project 2877676ccbd0484d80ecabf3030c0ee4. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:10:37 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:10:37 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.662418 Apr 13 19:10:37 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 200/591] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:10:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:10:37 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-1f332a3c-4324-4064-8b6d-c77475b6992f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:37 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-1f332a3c-4324-4064-8b6d-c77475b6992f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:38 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-1f332a3c-4324-4064-8b6d-c77475b6992f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80063ed703d24a1b84aede724db205a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2877676ccbd0484d80ecabf3030c0ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:10:38 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-1f332a3c-4324-4064-8b6d-c77475b6992f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/635717f5-c514-41a7-b9dc-a03d699173c5" status: 200 len: 1207 microversion: 2.1 time: 0.079844 Apr 13 19:10:38 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 196/592] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:10:37 2023] GET /compute/v2.1/servers/635717f5-c514-41a7-b9dc-a03d699173c5 => generated 1207 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:10:38 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d7ac2838-53fd-46f6-a106-41438ba1bb42 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:38 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-d7ac2838-53fd-46f6-a106-41438ba1bb42 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d7ac2838-53fd-46f6-a106-41438ba1bb42 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d7ac2838-53fd-46f6-a106-41438ba1bb42 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d7ac2838-53fd-46f6-a106-41438ba1bb42 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d7ac2838-53fd-46f6-a106-41438ba1bb42 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d7ac2838-53fd-46f6-a106-41438ba1bb42 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d7ac2838-53fd-46f6-a106-41438ba1bb42 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:38 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:38 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-d7ac2838-53fd-46f6-a106-41438ba1bb42 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047419 Apr 13 19:10:38 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 197/593] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:10:38 2023] GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:10:39 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:39 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:39 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32751522-5725-4cb4-a8bd-234dfe84780b", "tag": "24610878-c15b-4646-9dcf-ef49c99ae208"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:39 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] Creating event network-changed:24610878-c15b-4646-9dcf-ef49c99ae208 for instance 32751522-5725-4cb4-a8bd-234dfe84780b on user Apr 13 19:10:39 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030367 Apr 13 19:10:39 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 197/594] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:10:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:39 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:10:39 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b" status: 204 len: 0 microversion: 2.1 time: 0.148500 Apr 13 19:10:39 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 201/595] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:10:38 2023] DELETE /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:10:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-6d662814-3c40-43b0-83db-7f0603104ed8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:39 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-6d662814-3c40-43b0-83db-7f0603104ed8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6d662814-3c40-43b0-83db-7f0603104ed8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6d662814-3c40-43b0-83db-7f0603104ed8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6d662814-3c40-43b0-83db-7f0603104ed8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6d662814-3c40-43b0-83db-7f0603104ed8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6d662814-3c40-43b0-83db-7f0603104ed8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6d662814-3c40-43b0-83db-7f0603104ed8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:39 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-6d662814-3c40-43b0-83db-7f0603104ed8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7bcc69770a4859904f1b66cece61e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347c59f4ca945399a4323e689460d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:10:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-6d662814-3c40-43b0-83db-7f0603104ed8 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b" status: 200 len: 1662 microversion: 2.1 time: 0.203941 Apr 13 19:10:39 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 198/596] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:10:39 2023] GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b => generated 1662 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:10:40 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7687df57-6f7d-476b-ba56-cd9638c9df6d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:40 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-7687df57-6f7d-476b-ba56-cd9638c9df6d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7687df57-6f7d-476b-ba56-cd9638c9df6d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7687df57-6f7d-476b-ba56-cd9638c9df6d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7687df57-6f7d-476b-ba56-cd9638c9df6d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7687df57-6f7d-476b-ba56-cd9638c9df6d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7687df57-6f7d-476b-ba56-cd9638c9df6d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7687df57-6f7d-476b-ba56-cd9638c9df6d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:40 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-7687df57-6f7d-476b-ba56-cd9638c9df6d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] HTTP exception thrown: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:40 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7687df57-6f7d-476b-ba56-cd9638c9df6d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Request method failure captured: Apr 13 19:10:40 user devstack@n-api.service[61589]: request: DELETE /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae HTTP/1.1 Apr 13 19:10:40 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:10:40 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:10:40 user devstack@n-api.service[61589]: Connection: close Apr 13 19:10:40 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:10:40 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:10:40 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:10:40 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:10:40 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBklJWjujPp7_H2HyeXYwZV1Iyrbv0W_02hOgzZjJJa8Le36FOcl4nlEQ0OEaAHNMIkFNxhBLn_fFHQ41HweFRR9363GgB8bfDFQ6_bzBzTrNMLnQfkW2o5hfOos_zLtVE2MNRXKdsHe_6rHCrIpZt9oegglM1s6bbnyShXflzrk8A Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Project-Id: faabdcc8e61c452ab3b934b1c9501e68 Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faabdcc8e61c452ab3b934b1c9501e68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/faabdcc8e61c452ab3b934b1c9501e68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faabdcc8e61c452ab3b934b1c9501e68"}]}] Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Tenant-Id: faabdcc8e61c452ab3b934b1c9501e68 Apr 13 19:10:40 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:40 user devstack@n-api.service[61589]: X-User: tempest-AttachVolumeShelveTestJSON-1546308967-project-member Apr 13 19:10:40 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:10:40 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:10:40 user devstack@n-api.service[61589]: X-User-Id: ee6c76c605d54b4f84e0596b27087f0b Apr 13 19:10:40 user devstack@n-api.service[61589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1546308967-project-member Apr 13 19:10:40 user devstack@n-api.service[61589]: method: > Apr 13 19:10:40 user devstack@n-api.service[61589]: exception: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:40 user devstack@n-api.service[61589]: action_args: {'id': '2c2e4899-d6d5-422c-a4f1-61a8129abdae'} Apr 13 19:10:40 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:40 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:40 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7687df57-6f7d-476b-ba56-cd9638c9df6d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Returning 404 to user: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:10:40 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7687df57-6f7d-476b-ba56-cd9638c9df6d tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae" status: 404 len: 111 microversion: 2.20 time: 0.037645 Apr 13 19:10:40 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 198/597] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:10:40 2023] DELETE /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:10:40 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-93c94b65-0e67-4671-9d4a-2947defeab79 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:40 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-93c94b65-0e67-4671-9d4a-2947defeab79 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-93c94b65-0e67-4671-9d4a-2947defeab79 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-93c94b65-0e67-4671-9d4a-2947defeab79 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-93c94b65-0e67-4671-9d4a-2947defeab79 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-93c94b65-0e67-4671-9d4a-2947defeab79 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-93c94b65-0e67-4671-9d4a-2947defeab79 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-93c94b65-0e67-4671-9d4a-2947defeab79 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-93c94b65-0e67-4671-9d4a-2947defeab79 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] HTTP exception thrown: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:40 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-93c94b65-0e67-4671-9d4a-2947defeab79 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Request method failure captured: Apr 13 19:10:40 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae HTTP/1.1 Apr 13 19:10:40 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:10:40 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:10:40 user devstack@n-api.service[61587]: Connection: close Apr 13 19:10:40 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:10:40 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:10:40 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:10:40 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:10:40 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBklJWjujPp7_H2HyeXYwZV1Iyrbv0W_02hOgzZjJJa8Le36FOcl4nlEQ0OEaAHNMIkFNxhBLn_fFHQ41HweFRR9363GgB8bfDFQ6_bzBzTrNMLnQfkW2o5hfOos_zLtVE2MNRXKdsHe_6rHCrIpZt9oegglM1s6bbnyShXflzrk8A Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Project-Id: faabdcc8e61c452ab3b934b1c9501e68 Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faabdcc8e61c452ab3b934b1c9501e68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/faabdcc8e61c452ab3b934b1c9501e68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faabdcc8e61c452ab3b934b1c9501e68"}]}] Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Tenant-Id: faabdcc8e61c452ab3b934b1c9501e68 Apr 13 19:10:40 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:40 user devstack@n-api.service[61587]: X-User: tempest-AttachVolumeShelveTestJSON-1546308967-project-member Apr 13 19:10:40 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:10:40 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:10:40 user devstack@n-api.service[61587]: X-User-Id: ee6c76c605d54b4f84e0596b27087f0b Apr 13 19:10:40 user devstack@n-api.service[61587]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1546308967-project-member Apr 13 19:10:40 user devstack@n-api.service[61587]: method: > Apr 13 19:10:40 user devstack@n-api.service[61587]: exception: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:40 user devstack@n-api.service[61587]: action_args: {'id': '2c2e4899-d6d5-422c-a4f1-61a8129abdae'} Apr 13 19:10:40 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. Apr 13 19:10:40 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:10:40 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-93c94b65-0e67-4671-9d4a-2947defeab79 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Returning 404 to user: Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:10:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-93c94b65-0e67-4671-9d4a-2947defeab79 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae" status: 404 len: 111 microversion: 2.20 time: 0.031320 Apr 13 19:10:40 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 202/598] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:10:40 2023] GET /compute/v2.1/servers/2c2e4899-d6d5-422c-a4f1-61a8129abdae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:10:40 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635717f5-c514-41a7-b9dc-a03d699173c5", "tag": "78f7925f-87b3-4251-90e4-aec51a11e4ec"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] Creating event network-changed:78f7925f-87b3-4251-90e4-aec51a11e4ec for instance 635717f5-c514-41a7-b9dc-a03d699173c5 on user Apr 13 19:10:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058026 Apr 13 19:10:40 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 199/599] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:10:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:41 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32751522-5725-4cb4-a8bd-234dfe84780b", "name": "network-vif-unplugged", "status": "completed", "tag": "24610878-c15b-4646-9dcf-ef49c99ae208"}, {"server_uuid": "32751522-5725-4cb4-a8bd-234dfe84780b", "name": "network-vif-plugged", "status": "completed", "tag": "24610878-c15b-4646-9dcf-ef49c99ae208"}, {"server_uuid": "32751522-5725-4cb4-a8bd-234dfe84780b", "name": "network-vif-deleted", "tag": "24610878-c15b-4646-9dcf-ef49c99ae208"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Creating event network-vif-unplugged:24610878-c15b-4646-9dcf-ef49c99ae208 for instance 32751522-5725-4cb4-a8bd-234dfe84780b on user Apr 13 19:10:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Creating event network-vif-plugged:24610878-c15b-4646-9dcf-ef49c99ae208 for instance 32751522-5725-4cb4-a8bd-234dfe84780b on user Apr 13 19:10:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Creating event network-vif-deleted:24610878-c15b-4646-9dcf-ef49c99ae208 for instance 32751522-5725-4cb4-a8bd-234dfe84780b on user Apr 13 19:10:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.038087 Apr 13 19:10:41 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 199/600] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:43 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-a3f334b2-dad1-449c-95de-799f4831d74a req-dcdd6612-a1aa-439e-9fcc-f55b642e6b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635717f5-c514-41a7-b9dc-a03d699173c5", "name": "network-vif-plugged", "status": "completed", "tag": "78f7925f-87b3-4251-90e4-aec51a11e4ec"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-a3f334b2-dad1-449c-95de-799f4831d74a req-dcdd6612-a1aa-439e-9fcc-f55b642e6b14 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-a3f334b2-dad1-449c-95de-799f4831d74a req-dcdd6612-a1aa-439e-9fcc-f55b642e6b14 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-a3f334b2-dad1-449c-95de-799f4831d74a req-dcdd6612-a1aa-439e-9fcc-f55b642e6b14 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-a3f334b2-dad1-449c-95de-799f4831d74a req-dcdd6612-a1aa-439e-9fcc-f55b642e6b14 service nova] Creating event network-vif-plugged:78f7925f-87b3-4251-90e4-aec51a11e4ec for instance 635717f5-c514-41a7-b9dc-a03d699173c5 on user Apr 13 19:10:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-a3f334b2-dad1-449c-95de-799f4831d74a req-dcdd6612-a1aa-439e-9fcc-f55b642e6b14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046750 Apr 13 19:10:43 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 203/601] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:10:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:44 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0bc77299-6204-47c5-bb7a-68c288d2dd11 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:44 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-0bc77299-6204-47c5-bb7a-68c288d2dd11 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0bc77299-6204-47c5-bb7a-68c288d2dd11 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0bc77299-6204-47c5-bb7a-68c288d2dd11 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0bc77299-6204-47c5-bb7a-68c288d2dd11 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0bc77299-6204-47c5-bb7a-68c288d2dd11 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0bc77299-6204-47c5-bb7a-68c288d2dd11 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0bc77299-6204-47c5-bb7a-68c288d2dd11 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-0bc77299-6204-47c5-bb7a-68c288d2dd11 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] HTTP exception thrown: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:10:44 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0bc77299-6204-47c5-bb7a-68c288d2dd11 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Request method failure captured: Apr 13 19:10:44 user devstack@n-api.service[61588]: request: DELETE /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f HTTP/1.1 Apr 13 19:10:44 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:10:44 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:10:44 user devstack@n-api.service[61588]: Connection: close Apr 13 19:10:44 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:10:44 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:10:44 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:10:44 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:10:44 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBklJWjujPp7_H2HyeXYwZV1Iyrbv0W_02hOgzZjJJa8Le36FOcl4nlEQ0OEaAHNMIkFNxhBLn_fFHQ41HweFRR9363GgB8bfDFQ6_bzBzTrNMLnQfkW2o5hfOos_zLtVE2MNRXKdsHe_6rHCrIpZt9oegglM1s6bbnyShXflzrk8A Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Project-Id: faabdcc8e61c452ab3b934b1c9501e68 Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faabdcc8e61c452ab3b934b1c9501e68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/faabdcc8e61c452ab3b934b1c9501e68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faabdcc8e61c452ab3b934b1c9501e68"}]}] Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Tenant-Id: faabdcc8e61c452ab3b934b1c9501e68 Apr 13 19:10:44 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:44 user devstack@n-api.service[61588]: X-User: tempest-AttachVolumeShelveTestJSON-1546308967-project-member Apr 13 19:10:44 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:10:44 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:10:44 user devstack@n-api.service[61588]: X-User-Id: ee6c76c605d54b4f84e0596b27087f0b Apr 13 19:10:44 user devstack@n-api.service[61588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1546308967-project-member Apr 13 19:10:44 user devstack@n-api.service[61588]: method: > Apr 13 19:10:44 user devstack@n-api.service[61588]: exception: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:10:44 user devstack@n-api.service[61588]: action_args: {'id': 'ca1b4132-15bd-4d4e-8d0c-d074824c888f'} Apr 13 19:10:44 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:10:44 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:10:44 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0bc77299-6204-47c5-bb7a-68c288d2dd11 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Returning 404 to user: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:10:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-0bc77299-6204-47c5-bb7a-68c288d2dd11 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f" status: 404 len: 111 microversion: 2.20 time: 0.028908 Apr 13 19:10:44 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 200/602] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:10:44 2023] DELETE /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:10:44 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9f3fd3e6-685b-4fd8-bd4c-a1ffa08ee794 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:44 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-9f3fd3e6-685b-4fd8-bd4c-a1ffa08ee794 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9f3fd3e6-685b-4fd8-bd4c-a1ffa08ee794 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9f3fd3e6-685b-4fd8-bd4c-a1ffa08ee794 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9f3fd3e6-685b-4fd8-bd4c-a1ffa08ee794 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9f3fd3e6-685b-4fd8-bd4c-a1ffa08ee794 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9f3fd3e6-685b-4fd8-bd4c-a1ffa08ee794 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9f3fd3e6-685b-4fd8-bd4c-a1ffa08ee794 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:44 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-9f3fd3e6-685b-4fd8-bd4c-a1ffa08ee794 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] HTTP exception thrown: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:10:44 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9f3fd3e6-685b-4fd8-bd4c-a1ffa08ee794 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Request method failure captured: Apr 13 19:10:44 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f HTTP/1.1 Apr 13 19:10:44 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:10:44 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:10:44 user devstack@n-api.service[61589]: Connection: close Apr 13 19:10:44 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:10:44 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:10:44 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:10:44 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:10:44 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBklJWjujPp7_H2HyeXYwZV1Iyrbv0W_02hOgzZjJJa8Le36FOcl4nlEQ0OEaAHNMIkFNxhBLn_fFHQ41HweFRR9363GgB8bfDFQ6_bzBzTrNMLnQfkW2o5hfOos_zLtVE2MNRXKdsHe_6rHCrIpZt9oegglM1s6bbnyShXflzrk8A Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Project-Id: faabdcc8e61c452ab3b934b1c9501e68 Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faabdcc8e61c452ab3b934b1c9501e68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/faabdcc8e61c452ab3b934b1c9501e68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/faabdcc8e61c452ab3b934b1c9501e68"}]}] Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Tenant-Id: faabdcc8e61c452ab3b934b1c9501e68 Apr 13 19:10:44 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1546308967 Apr 13 19:10:44 user devstack@n-api.service[61589]: X-User: tempest-AttachVolumeShelveTestJSON-1546308967-project-member Apr 13 19:10:44 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:10:44 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:10:44 user devstack@n-api.service[61589]: X-User-Id: ee6c76c605d54b4f84e0596b27087f0b Apr 13 19:10:44 user devstack@n-api.service[61589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1546308967-project-member Apr 13 19:10:44 user devstack@n-api.service[61589]: method: > Apr 13 19:10:44 user devstack@n-api.service[61589]: exception: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:10:44 user devstack@n-api.service[61589]: action_args: {'id': 'ca1b4132-15bd-4d4e-8d0c-d074824c888f'} Apr 13 19:10:44 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. Apr 13 19:10:44 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:10:44 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9f3fd3e6-685b-4fd8-bd4c-a1ffa08ee794 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Returning 404 to user: Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:10:44 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-9f3fd3e6-685b-4fd8-bd4c-a1ffa08ee794 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f" status: 404 len: 111 microversion: 2.20 time: 0.039469 Apr 13 19:10:44 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 200/603] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:10:44 2023] GET /compute/v2.1/servers/ca1b4132-15bd-4d4e-8d0c-d074824c888f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:10:45 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-aa1d9dc6-4ca4-4e54-a9ad-d7089ec1e966 req-336c9a13-c1f9-49af-9a2f-5e64a5a147a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635717f5-c514-41a7-b9dc-a03d699173c5", "name": "network-vif-plugged", "status": "completed", "tag": "78f7925f-87b3-4251-90e4-aec51a11e4ec"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:45 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-aa1d9dc6-4ca4-4e54-a9ad-d7089ec1e966 req-336c9a13-c1f9-49af-9a2f-5e64a5a147a2 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:45 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-aa1d9dc6-4ca4-4e54-a9ad-d7089ec1e966 req-336c9a13-c1f9-49af-9a2f-5e64a5a147a2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:45 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-aa1d9dc6-4ca4-4e54-a9ad-d7089ec1e966 req-336c9a13-c1f9-49af-9a2f-5e64a5a147a2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:45 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-aa1d9dc6-4ca4-4e54-a9ad-d7089ec1e966 req-336c9a13-c1f9-49af-9a2f-5e64a5a147a2 service nova] Creating event network-vif-plugged:78f7925f-87b3-4251-90e4-aec51a11e4ec for instance 635717f5-c514-41a7-b9dc-a03d699173c5 on user Apr 13 19:10:45 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-aa1d9dc6-4ca4-4e54-a9ad-d7089ec1e966 req-336c9a13-c1f9-49af-9a2f-5e64a5a147a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042274 Apr 13 19:10:45 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 204/604] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:10:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:55 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:55 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=15 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:55 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d0f525ad-33aa-4ae8-8e88-62bceafaa6ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: .version_select at 0x7efe33fcf640>, body: {"keypair": {"name": "tempest-keypair-1344017995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKdS7h4tFyxpAMeYLQuh8ih425eVCG7EZMy8h5k1UPuzrtZ/SoBsVJTEzpMJsvBkj1pJCZh3INmXLgWHuWn9olcGY7rfHpFr8uXlLrmR2vq4y76F919hEdaBpypdO4nAA=="}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:55 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-d0f525ad-33aa-4ae8-8e88-62bceafaa6ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'key_pairs'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:10:55 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-d0f525ad-33aa-4ae8-8e88-62bceafaa6ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for user 975d5fe9f1e445f0ba1be8fc71e93ecc and project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'key_pairs'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:10:55 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-d0f525ad-33aa-4ae8-8e88-62bceafaa6ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163144 Apr 13 19:10:55 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 201/605] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:10:55 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2113721344", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c6740647-dbe4-4a73-ada4-b154eca2af81"}], "security_groups": [{"name": "tempest-securitygroup--628238815"}], "key_name": "tempest-keypair-1344017995", "user_data": "}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=14 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=10 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] validate_networks() for [('c6740647-dbe4-4a73-ada4-b154eca2af81', None, None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for user 975d5fe9f1e445f0ba1be8fc71e93ecc and project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:10:57 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:10:57 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.651711 Apr 13 19:10:57 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 201/606] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:10:57 2023] POST /compute/v2.1/servers => generated 399 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:10:57 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:57 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:57 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:57 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:10:57 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3a6e3b72-a91b-4702-9bbb-0493df2ee71d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:10:57 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-3a6e3b72-a91b-4702-9bbb-0493df2ee71d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:10:57 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-3a6e3b72-a91b-4702-9bbb-0493df2ee71d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:10:57 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-3a6e3b72-a91b-4702-9bbb-0493df2ee71d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" status: 200 len: 1236 microversion: 2.1 time: 0.078010 Apr 13 19:10:57 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 205/607] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:10:57 2023] GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:11:00 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d", "tag": "e124e179-0315-423a-b9cf-c232753845ed"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:00 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] Creating event network-changed:e124e179-0315-423a-b9cf-c232753845ed for instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d on user Apr 13 19:11:00 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028184 Apr 13 19:11:00 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 202/608] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:11:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:11:02 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-127e3259-8aad-46e3-924d-e0a498c21367 req-4f27db26-c6b3-49ae-b2bb-c009d8c6a04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d", "name": "network-vif-plugged", "status": "completed", "tag": "e124e179-0315-423a-b9cf-c232753845ed"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-127e3259-8aad-46e3-924d-e0a498c21367 req-4f27db26-c6b3-49ae-b2bb-c009d8c6a04e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-127e3259-8aad-46e3-924d-e0a498c21367 req-4f27db26-c6b3-49ae-b2bb-c009d8c6a04e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-127e3259-8aad-46e3-924d-e0a498c21367 req-4f27db26-c6b3-49ae-b2bb-c009d8c6a04e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:02 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-127e3259-8aad-46e3-924d-e0a498c21367 req-4f27db26-c6b3-49ae-b2bb-c009d8c6a04e service nova] Creating event network-vif-plugged:e124e179-0315-423a-b9cf-c232753845ed for instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d on user Apr 13 19:11:02 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-127e3259-8aad-46e3-924d-e0a498c21367 req-4f27db26-c6b3-49ae-b2bb-c009d8c6a04e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042028 Apr 13 19:11:02 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 202/609] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:11:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:11:04 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-78d432e7-b909-44da-8669-ace96c5dcaf0 req-92aa8d61-68fc-4397-a3b0-0303407e830e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d", "name": "network-vif-plugged", "status": "completed", "tag": "e124e179-0315-423a-b9cf-c232753845ed"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-78d432e7-b909-44da-8669-ace96c5dcaf0 req-92aa8d61-68fc-4397-a3b0-0303407e830e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-78d432e7-b909-44da-8669-ace96c5dcaf0 req-92aa8d61-68fc-4397-a3b0-0303407e830e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-78d432e7-b909-44da-8669-ace96c5dcaf0 req-92aa8d61-68fc-4397-a3b0-0303407e830e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:04 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-78d432e7-b909-44da-8669-ace96c5dcaf0 req-92aa8d61-68fc-4397-a3b0-0303407e830e service nova] Creating event network-vif-plugged:e124e179-0315-423a-b9cf-c232753845ed for instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d on user Apr 13 19:11:04 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-78d432e7-b909-44da-8669-ace96c5dcaf0 req-92aa8d61-68fc-4397-a3b0-0303407e830e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035964 Apr 13 19:11:04 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 206/610] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:11:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:11:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:05 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:05 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61588) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 19:11:05 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333/action" status: 202 len: 0 microversion: 2.1 time: 0.105253 Apr 13 19:11:05 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 203/611] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:11:05 2023] POST /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:11:05 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-0ca4a4ab-76d8-41ef-846e-3cc2ef150b21 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:05 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-0ca4a4ab-76d8-41ef-846e-3cc2ef150b21 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0ca4a4ab-76d8-41ef-846e-3cc2ef150b21 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0ca4a4ab-76d8-41ef-846e-3cc2ef150b21 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0ca4a4ab-76d8-41ef-846e-3cc2ef150b21 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0ca4a4ab-76d8-41ef-846e-3cc2ef150b21 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0ca4a4ab-76d8-41ef-846e-3cc2ef150b21 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0ca4a4ab-76d8-41ef-846e-3cc2ef150b21 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:05 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-0ca4a4ab-76d8-41ef-846e-3cc2ef150b21 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44f04fabef14935a4617dd452d3999b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8fe614f0541009788ffe685720634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:11:05 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-0ca4a4ab-76d8-41ef-846e-3cc2ef150b21 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" status: 200 len: 1503 microversion: 2.1 time: 0.159371 Apr 13 19:11:05 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 203/612] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:11:05 2023] GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0e7669b2-6056-40ea-8057-06d2c9f7c8af tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-0e7669b2-6056-40ea-8057-06d2c9f7c8af tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0e7669b2-6056-40ea-8057-06d2c9f7c8af tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0e7669b2-6056-40ea-8057-06d2c9f7c8af tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0e7669b2-6056-40ea-8057-06d2c9f7c8af tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0e7669b2-6056-40ea-8057-06d2c9f7c8af tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0e7669b2-6056-40ea-8057-06d2c9f7c8af tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0e7669b2-6056-40ea-8057-06d2c9f7c8af tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:07 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-0e7669b2-6056-40ea-8057-06d2c9f7c8af tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HTTP exception thrown: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0e7669b2-6056-40ea-8057-06d2c9f7c8af tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Request method failure captured: Apr 13 19:11:07 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 HTTP/1.1 Apr 13 19:11:07 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:11:07 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:11:07 user devstack@n-api.service[61587]: Connection: close Apr 13 19:11:07 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:11:07 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:11:07 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:11:07 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:11:07 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBlNOWHCTMQFhEy-J7a2c-bBW9BYSiLEOuq4QoVDDv1EVfFMjZ25Ph853NFwBdH11xS3Mqv7Dy9ybmURzfKRfyWi697O6pLOyn5O9BBYr739mk-f3LssIPTYGf8Vavom6lNQh3pv5dsPZEl9SILs5NibB7-FcDC1lhHGpeko0c1qsI Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Project-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Project-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}] Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Tenant: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Tenant-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:11:07 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:11:07 user devstack@n-api.service[61587]: X-User: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:11:07 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:11:07 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:11:07 user devstack@n-api.service[61587]: X-User-Id: df209814208d415e9d414d39205aaad6 Apr 13 19:11:07 user devstack@n-api.service[61587]: X-User-Name: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:11:07 user devstack@n-api.service[61587]: method: > Apr 13 19:11:07 user devstack@n-api.service[61587]: exception: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61587]: action_args: {'id': 'b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8'} Apr 13 19:11:07 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0e7669b2-6056-40ea-8057-06d2c9f7c8af tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Returning 404 to user: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:11:07 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-0e7669b2-6056-40ea-8057-06d2c9f7c8af tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 404 len: 111 microversion: 2.1 time: 0.051418 Apr 13 19:11:07 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 207/613] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:11:07 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:11:07 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e4426382-4350-4bdd-9b8a-9b3c4d753826 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:07 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e4426382-4350-4bdd-9b8a-9b3c4d753826 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e4426382-4350-4bdd-9b8a-9b3c4d753826 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e4426382-4350-4bdd-9b8a-9b3c4d753826 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e4426382-4350-4bdd-9b8a-9b3c4d753826 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e4426382-4350-4bdd-9b8a-9b3c4d753826 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e4426382-4350-4bdd-9b8a-9b3c4d753826 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e4426382-4350-4bdd-9b8a-9b3c4d753826 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:07 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-e4426382-4350-4bdd-9b8a-9b3c4d753826 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HTTP exception thrown: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e4426382-4350-4bdd-9b8a-9b3c4d753826 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Request method failure captured: Apr 13 19:11:07 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments HTTP/1.1 Apr 13 19:11:07 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:11:07 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:11:07 user devstack@n-api.service[61588]: Connection: close Apr 13 19:11:07 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:11:07 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:11:07 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:11:07 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:11:07 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBlNOWHCTMQFhEy-J7a2c-bBW9BYSiLEOuq4QoVDDv1EVfFMjZ25Ph853NFwBdH11xS3Mqv7Dy9ybmURzfKRfyWi697O6pLOyn5O9BBYr739mk-f3LssIPTYGf8Vavom6lNQh3pv5dsPZEl9SILs5NibB7-FcDC1lhHGpeko0c1qsI Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Project-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Project-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}] Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Tenant: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Tenant-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:11:07 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:11:07 user devstack@n-api.service[61588]: X-User: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:11:07 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:11:07 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:11:07 user devstack@n-api.service[61588]: X-User-Id: df209814208d415e9d414d39205aaad6 Apr 13 19:11:07 user devstack@n-api.service[61588]: X-User-Name: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:11:07 user devstack@n-api.service[61588]: method: > Apr 13 19:11:07 user devstack@n-api.service[61588]: exception: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61588]: action_args: {'server_id': 'b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8'} Apr 13 19:11:07 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e4426382-4350-4bdd-9b8a-9b3c4d753826 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Returning 404 to user: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:11:07 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e4426382-4350-4bdd-9b8a-9b3c4d753826 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032629 Apr 13 19:11:07 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 204/614] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:11:07 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:11:07 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-cdd3d05b-5568-4c58-97d7-12da2b8eb02b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:07 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-cdd3d05b-5568-4c58-97d7-12da2b8eb02b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cdd3d05b-5568-4c58-97d7-12da2b8eb02b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cdd3d05b-5568-4c58-97d7-12da2b8eb02b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cdd3d05b-5568-4c58-97d7-12da2b8eb02b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cdd3d05b-5568-4c58-97d7-12da2b8eb02b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cdd3d05b-5568-4c58-97d7-12da2b8eb02b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-cdd3d05b-5568-4c58-97d7-12da2b8eb02b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:07 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-cdd3d05b-5568-4c58-97d7-12da2b8eb02b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HTTP exception thrown: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-cdd3d05b-5568-4c58-97d7-12da2b8eb02b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Request method failure captured: Apr 13 19:11:07 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 HTTP/1.1 Apr 13 19:11:07 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:11:07 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:11:07 user devstack@n-api.service[61589]: Connection: close Apr 13 19:11:07 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:11:07 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:11:07 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:11:07 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:11:07 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBlNOWHCTMQFhEy-J7a2c-bBW9BYSiLEOuq4QoVDDv1EVfFMjZ25Ph853NFwBdH11xS3Mqv7Dy9ybmURzfKRfyWi697O6pLOyn5O9BBYr739mk-f3LssIPTYGf8Vavom6lNQh3pv5dsPZEl9SILs5NibB7-FcDC1lhHGpeko0c1qsI Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Project-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Project-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}] Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Tenant: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Tenant-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:11:07 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:11:07 user devstack@n-api.service[61589]: X-User: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:11:07 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:11:07 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:11:07 user devstack@n-api.service[61589]: X-User-Id: df209814208d415e9d414d39205aaad6 Apr 13 19:11:07 user devstack@n-api.service[61589]: X-User-Name: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:11:07 user devstack@n-api.service[61589]: method: > Apr 13 19:11:07 user devstack@n-api.service[61589]: exception: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61589]: action_args: {'id': 'b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8'} Apr 13 19:11:07 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:11:07 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:11:07 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-cdd3d05b-5568-4c58-97d7-12da2b8eb02b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Returning 404 to user: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:11:07 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-cdd3d05b-5568-4c58-97d7-12da2b8eb02b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 404 len: 111 microversion: 2.1 time: 0.038722 Apr 13 19:11:07 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 204/615] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:11:07 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-624786944", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f"}], "security_groups": [{"name": "tempest-securitygroup--1715513541"}], "key_name": "tempest-keypair-479347877", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] validate_networks() for [('53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:11:07 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for project c162f91cba4b4ecf9de48fbf839da261. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for user df209814208d415e9d414d39205aaad6 and project c162f91cba4b4ecf9de48fbf839da261. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:11:08 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:11:08 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.598570 Apr 13 19:11:08 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 208/616] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:11:07 2023] POST /compute/v2.1/servers => generated 404 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:11:08 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4ddf4060-2e42-47fa-a99f-31de9cfdbc0b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:08 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-4ddf4060-2e42-47fa-a99f-31de9cfdbc0b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:08 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-4ddf4060-2e42-47fa-a99f-31de9cfdbc0b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:11:08 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-4ddf4060-2e42-47fa-a99f-31de9cfdbc0b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba" status: 200 len: 1231 microversion: 2.1 time: 0.063744 Apr 13 19:11:08 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 205/617] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:11:08 2023] GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba => generated 1231 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:11:10 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579c83e7-7976-47f4-9f25-a194e39966ba", "tag": "ab959649-556a-479c-9e13-ec36fb9ebb66"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:10 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:10 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:10 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] Creating event network-changed:ab959649-556a-479c-9e13-ec36fb9ebb66 for instance 579c83e7-7976-47f4-9f25-a194e39966ba on user Apr 13 19:11:10 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052455 Apr 13 19:11:10 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 205/618] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:11:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:11:12 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:12 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] Creating event network-changed:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:11:12 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038760 Apr 13 19:11:12 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 209/619] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:11:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:11:12 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-3e448b24-9fb5-4534-ad3d-db2f0ee4c8a0 req-e8024cec-fdad-4a19-8958-473fdf424f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579c83e7-7976-47f4-9f25-a194e39966ba", "name": "network-vif-plugged", "status": "completed", "tag": "ab959649-556a-479c-9e13-ec36fb9ebb66"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-3e448b24-9fb5-4534-ad3d-db2f0ee4c8a0 req-e8024cec-fdad-4a19-8958-473fdf424f35 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-3e448b24-9fb5-4534-ad3d-db2f0ee4c8a0 req-e8024cec-fdad-4a19-8958-473fdf424f35 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-3e448b24-9fb5-4534-ad3d-db2f0ee4c8a0 req-e8024cec-fdad-4a19-8958-473fdf424f35 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:13 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-3e448b24-9fb5-4534-ad3d-db2f0ee4c8a0 req-e8024cec-fdad-4a19-8958-473fdf424f35 service nova] Creating event network-vif-plugged:ab959649-556a-479c-9e13-ec36fb9ebb66 for instance 579c83e7-7976-47f4-9f25-a194e39966ba on user Apr 13 19:11:13 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-3e448b24-9fb5-4534-ad3d-db2f0ee4c8a0 req-e8024cec-fdad-4a19-8958-473fdf424f35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045345 Apr 13 19:11:13 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 206/620] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:11:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:11:15 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-fbc06013-1a20-4098-97aa-f5bf490b17d7 req-6e558e44-1f2e-4fa1-ab64-ea562d58fab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579c83e7-7976-47f4-9f25-a194e39966ba", "name": "network-vif-plugged", "status": "completed", "tag": "ab959649-556a-479c-9e13-ec36fb9ebb66"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-fbc06013-1a20-4098-97aa-f5bf490b17d7 req-6e558e44-1f2e-4fa1-ab64-ea562d58fab1 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-fbc06013-1a20-4098-97aa-f5bf490b17d7 req-6e558e44-1f2e-4fa1-ab64-ea562d58fab1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-fbc06013-1a20-4098-97aa-f5bf490b17d7 req-6e558e44-1f2e-4fa1-ab64-ea562d58fab1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-fbc06013-1a20-4098-97aa-f5bf490b17d7 req-6e558e44-1f2e-4fa1-ab64-ea562d58fab1 service nova] Creating event network-vif-plugged:ab959649-556a-479c-9e13-ec36fb9ebb66 for instance 579c83e7-7976-47f4-9f25-a194e39966ba on user Apr 13 19:11:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-fbc06013-1a20-4098-97aa-f5bf490b17d7 req-6e558e44-1f2e-4fa1-ab64-ea562d58fab1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033944 Apr 13 19:11:15 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 206/621] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:11:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:11:15 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-6e038509-c7ff-4dd6-94c8-e203949d604f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:15 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-6e038509-c7ff-4dd6-94c8-e203949d604f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-6e038509-c7ff-4dd6-94c8-e203949d604f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-6e038509-c7ff-4dd6-94c8-e203949d604f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-6e038509-c7ff-4dd6-94c8-e203949d604f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-6e038509-c7ff-4dd6-94c8-e203949d604f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-6e038509-c7ff-4dd6-94c8-e203949d604f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-6e038509-c7ff-4dd6-94c8-e203949d604f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:15 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-6e038509-c7ff-4dd6-94c8-e203949d604f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:11:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-6e038509-c7ff-4dd6-94c8-e203949d604f tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f" status: 200 len: 1503 microversion: 2.1 time: 0.194070 Apr 13 19:11:15 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 210/622] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:11:15 2023] GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:11:17 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "name": "network-vif-plugged", "status": "completed", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}, {"server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "name": "network-vif-plugged", "status": "completed", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:17 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] Creating event network-vif-plugged:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:11:17 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] Creating event network-vif-plugged:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:11:17 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033007 Apr 13 19:11:17 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 207/623] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:11:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:11:18 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e475cbd2-8e50-4c11-8286-52a2be226dff tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:18 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e475cbd2-8e50-4c11-8286-52a2be226dff tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e475cbd2-8e50-4c11-8286-52a2be226dff tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e475cbd2-8e50-4c11-8286-52a2be226dff tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e475cbd2-8e50-4c11-8286-52a2be226dff tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e475cbd2-8e50-4c11-8286-52a2be226dff tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e475cbd2-8e50-4c11-8286-52a2be226dff tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:18 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e475cbd2-8e50-4c11-8286-52a2be226dff tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:18 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e475cbd2-8e50-4c11-8286-52a2be226dff tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.090847 Apr 13 19:11:18 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 207/624] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 19:11:18 2023] GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:11:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:19 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:19 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:19 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:19 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1534060386"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:19 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] Creating event network-changed:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:11:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098084 Apr 13 19:11:19 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 211/625] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:11:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:11:20 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "POST /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/action" status: 202 len: 0 microversion: 2.1 time: 0.970022 Apr 13 19:11:20 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 208/626] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:11:19 2023] POST /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/action => generated 0 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 19:11:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d2fc07fc-2628-443d-b448-317f8bd7d48f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '.version_select at 0x7efe33eee560>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:20 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d2fc07fc-2628-443d-b448-317f8bd7d48f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/images/36e14854-8ca1-420d-8642-21ad4d51b5d6" status: 200 len: 1609 microversion: 2.1 time: 0.163720 Apr 13 19:11:20 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 208/627] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 19:11:20 2023] GET /compute/v2.1/images/36e14854-8ca1-420d-8642-21ad4d51b5d6 => generated 1609 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:11:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-5189566b-b912-413b-86c3-6eb8ead29da5 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:28 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-5189566b-b912-413b-86c3-6eb8ead29da5 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:28 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5189566b-b912-413b-86c3-6eb8ead29da5 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5189566b-b912-413b-86c3-6eb8ead29da5 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5189566b-b912-413b-86c3-6eb8ead29da5 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5189566b-b912-413b-86c3-6eb8ead29da5 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5189566b-b912-413b-86c3-6eb8ead29da5 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5189566b-b912-413b-86c3-6eb8ead29da5 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:28 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=17 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:28 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-5189566b-b912-413b-86c3-6eb8ead29da5 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80063ed703d24a1b84aede724db205a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2877676ccbd0484d80ecabf3030c0ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:11:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-5189566b-b912-413b-86c3-6eb8ead29da5 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/635717f5-c514-41a7-b9dc-a03d699173c5" status: 200 len: 1485 microversion: 2.1 time: 0.188645 Apr 13 19:11:28 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 212/628] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:11:28 2023] GET /compute/v2.1/servers/635717f5-c514-41a7-b9dc-a03d699173c5 => generated 1485 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:11:29 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-90aa441a-11f7-4555-a0e7-f9083e0c3667 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:29 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-90aa441a-11f7-4555-a0e7-f9083e0c3667 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:29 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-90aa441a-11f7-4555-a0e7-f9083e0c3667 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-90aa441a-11f7-4555-a0e7-f9083e0c3667 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-90aa441a-11f7-4555-a0e7-f9083e0c3667 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-90aa441a-11f7-4555-a0e7-f9083e0c3667 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-90aa441a-11f7-4555-a0e7-f9083e0c3667 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-90aa441a-11f7-4555-a0e7-f9083e0c3667 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:29 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:29 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-90aa441a-11f7-4555-a0e7-f9083e0c3667 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] HTTP exception thrown: Instance 32751522-5725-4cb4-a8bd-234dfe84780b could not be found. Apr 13 19:11:29 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-90aa441a-11f7-4555-a0e7-f9083e0c3667 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Request method failure captured: Apr 13 19:11:29 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b HTTP/1.1 Apr 13 19:11:29 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:11:29 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:11:29 user devstack@n-api.service[61588]: Connection: close Apr 13 19:11:29 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:11:29 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:11:29 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:11:29 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:11:29 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFI-MIpNnS-TJhUw5FVssqoXE1_u-b4rA4wy20Qs6f8JhiujZfuUquehGyCa7r8448Gx4_6fciTBLys7U9XnVCvCievRK7BW2d7c9t18cfBSoQdHT6c2oRx-ai_oUU1951a4VGdPo4pLr-wjYQ3Mx2ZfIzZv77Hlk2pJl6fUBYQU7ME Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Project-Id: 3347c59f4ca945399a4323e689460d12 Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Project-Name: tempest-TestStampPattern-456915878 Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3347c59f4ca945399a4323e689460d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3347c59f4ca945399a4323e689460d12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3347c59f4ca945399a4323e689460d12"}]}] Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Tenant: tempest-TestStampPattern-456915878 Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Tenant-Id: 3347c59f4ca945399a4323e689460d12 Apr 13 19:11:29 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TestStampPattern-456915878 Apr 13 19:11:29 user devstack@n-api.service[61588]: X-User: tempest-TestStampPattern-456915878-project-member Apr 13 19:11:29 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:11:29 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:11:29 user devstack@n-api.service[61588]: X-User-Id: cb7bcc69770a4859904f1b66cece61e3 Apr 13 19:11:29 user devstack@n-api.service[61588]: X-User-Name: tempest-TestStampPattern-456915878-project-member Apr 13 19:11:29 user devstack@n-api.service[61588]: method: > Apr 13 19:11:29 user devstack@n-api.service[61588]: exception: Instance 32751522-5725-4cb4-a8bd-234dfe84780b could not be found. Apr 13 19:11:29 user devstack@n-api.service[61588]: action_args: {'id': '32751522-5725-4cb4-a8bd-234dfe84780b'} Apr 13 19:11:29 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32751522-5725-4cb4-a8bd-234dfe84780b could not be found. Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32751522-5725-4cb4-a8bd-234dfe84780b could not be found. Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32751522-5725-4cb4-a8bd-234dfe84780b could not be found. Apr 13 19:11:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:11:29 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-90aa441a-11f7-4555-a0e7-f9083e0c3667 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Returning 404 to user: Instance 32751522-5725-4cb4-a8bd-234dfe84780b could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:11:29 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-90aa441a-11f7-4555-a0e7-f9083e0c3667 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b" status: 404 len: 111 microversion: 2.1 time: 0.033001 Apr 13 19:11:29 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 209/629] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:11:29 2023] GET /compute/v2.1/servers/32751522-5725-4cb4-a8bd-234dfe84780b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:11:34 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:34 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=20 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-de33b82f-5972-4b24-a523-508f781d25db tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:34 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-de33b82f-5972-4b24-a523-508f781d25db tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-de33b82f-5972-4b24-a523-508f781d25db tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-de33b82f-5972-4b24-a523-508f781d25db tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-de33b82f-5972-4b24-a523-508f781d25db tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-de33b82f-5972-4b24-a523-508f781d25db tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-de33b82f-5972-4b24-a523-508f781d25db tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-de33b82f-5972-4b24-a523-508f781d25db tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-de33b82f-5972-4b24-a523-508f781d25db tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] HTTP exception thrown: Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d is not attached to volume 65b3e6f5-d237-4a98-907e-49350dc04a3c Apr 13 19:11:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-de33b82f-5972-4b24-a523-508f781d25db tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Request method failure captured: Apr 13 19:11:34 user devstack@n-api.service[61589]: request: DELETE /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/os-volume_attachments/65b3e6f5-d237-4a98-907e-49350dc04a3c HTTP/1.1 Apr 13 19:11:34 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:11:34 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:11:34 user devstack@n-api.service[61589]: Connection: close Apr 13 19:11:34 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:11:34 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:11:34 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:11:34 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:11:34 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFI-MIpNnS-TJhUw5FVssqoXE1_u-b4rA4wy20Qs6f8JhiujZfuUquehGyCa7r8448Gx4_6fciTBLys7U9XnVCvCievRK7BW2d7c9t18cfBSoQdHT6c2oRx-ai_oUU1951a4VGdPo4pLr-wjYQ3Mx2ZfIzZv77Hlk2pJl6fUBYQU7ME Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Project-Id: 3347c59f4ca945399a4323e689460d12 Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Project-Name: tempest-TestStampPattern-456915878 Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3347c59f4ca945399a4323e689460d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3347c59f4ca945399a4323e689460d12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3347c59f4ca945399a4323e689460d12"}]}] Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Tenant: tempest-TestStampPattern-456915878 Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Tenant-Id: 3347c59f4ca945399a4323e689460d12 Apr 13 19:11:34 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-TestStampPattern-456915878 Apr 13 19:11:34 user devstack@n-api.service[61589]: X-User: tempest-TestStampPattern-456915878-project-member Apr 13 19:11:34 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:11:34 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:11:34 user devstack@n-api.service[61589]: X-User-Id: cb7bcc69770a4859904f1b66cece61e3 Apr 13 19:11:34 user devstack@n-api.service[61589]: X-User-Name: tempest-TestStampPattern-456915878-project-member Apr 13 19:11:34 user devstack@n-api.service[61589]: method: > Apr 13 19:11:34 user devstack@n-api.service[61589]: exception: Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d is not attached to volume 65b3e6f5-d237-4a98-907e-49350dc04a3c Apr 13 19:11:34 user devstack@n-api.service[61589]: action_args: {'server_id': 'cb3fb753-ff8d-4dac-ab70-f940233bf25d', 'id': '65b3e6f5-d237-4a98-907e-49350dc04a3c'} Apr 13 19:11:34 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 65b3e6f5-d237-4a98-907e-49350dc04a3c. Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d is not attached to volume 65b3e6f5-d237-4a98-907e-49350dc04a3c Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d is not attached to volume 65b3e6f5-d237-4a98-907e-49350dc04a3c Apr 13 19:11:34 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:11:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-de33b82f-5972-4b24-a523-508f781d25db tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Returning 404 to user: Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d is not attached to volume 65b3e6f5-d237-4a98-907e-49350dc04a3c {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:11:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-de33b82f-5972-4b24-a523-508f781d25db tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/os-volume_attachments/65b3e6f5-d237-4a98-907e-49350dc04a3c" status: 404 len: 154 microversion: 2.1 time: 0.202799 Apr 13 19:11:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 209/630] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:11:34 2023] DELETE /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d/os-volume_attachments/65b3e6f5-d237-4a98-907e-49350dc04a3c => generated 154 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:11:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:34 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb3fb753-ff8d-4dac-ab70-f940233bf25d", "tag": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:35 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] Creating event network-changed:cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 for instance cb3fb753-ff8d-4dac-ab70-f940233bf25d on user Apr 13 19:11:35 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031597 Apr 13 19:11:35 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:11:35 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 210/631] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:11:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:11:35 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d" status: 204 len: 0 microversion: 2.1 time: 0.132550 Apr 13 19:11:35 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 213/632] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:11:34 2023] DELETE /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:11:35 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9cb27453-9e03-496a-9e52-0ea3b904d8ed tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:35 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-9cb27453-9e03-496a-9e52-0ea3b904d8ed tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9cb27453-9e03-496a-9e52-0ea3b904d8ed tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9cb27453-9e03-496a-9e52-0ea3b904d8ed tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9cb27453-9e03-496a-9e52-0ea3b904d8ed tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9cb27453-9e03-496a-9e52-0ea3b904d8ed tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9cb27453-9e03-496a-9e52-0ea3b904d8ed tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9cb27453-9e03-496a-9e52-0ea3b904d8ed tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:35 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-9cb27453-9e03-496a-9e52-0ea3b904d8ed tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7bcc69770a4859904f1b66cece61e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347c59f4ca945399a4323e689460d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:11:35 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-9cb27453-9e03-496a-9e52-0ea3b904d8ed tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d" status: 200 len: 1663 microversion: 2.1 time: 0.195198 Apr 13 19:11:35 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 210/633] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:11:35 2023] GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d => generated 1663 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:11:37 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3fb753-ff8d-4dac-ab70-f940233bf25d", "name": "network-vif-unplugged", "status": "completed", "tag": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818"}, {"server_uuid": "cb3fb753-ff8d-4dac-ab70-f940233bf25d", "name": "network-vif-plugged", "status": "completed", "tag": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818"}, {"server_uuid": "cb3fb753-ff8d-4dac-ab70-f940233bf25d", "name": "network-vif-deleted", "tag": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:11:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Creating event network-vif-unplugged:cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 for instance cb3fb753-ff8d-4dac-ab70-f940233bf25d on user Apr 13 19:11:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Creating event network-vif-plugged:cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 for instance cb3fb753-ff8d-4dac-ab70-f940233bf25d on user Apr 13 19:11:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Creating event network-vif-deleted:cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 for instance cb3fb753-ff8d-4dac-ab70-f940233bf25d on user Apr 13 19:11:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.032043 Apr 13 19:11:37 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 211/634] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:11:37 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:11:47 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:47 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:47 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-b709631a-11f7-4658-ae71-b1501e79bdc0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:47 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-b709631a-11f7-4658-ae71-b1501e79bdc0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b709631a-11f7-4658-ae71-b1501e79bdc0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b709631a-11f7-4658-ae71-b1501e79bdc0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b709631a-11f7-4658-ae71-b1501e79bdc0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b709631a-11f7-4658-ae71-b1501e79bdc0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b709631a-11f7-4658-ae71-b1501e79bdc0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:47 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b709631a-11f7-4658-ae71-b1501e79bdc0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:48 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-b709631a-11f7-4658-ae71-b1501e79bdc0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:11:48 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-b709631a-11f7-4658-ae71-b1501e79bdc0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" status: 200 len: 1545 microversion: 2.1 time: 0.218581 Apr 13 19:11:48 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 214/635] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:11:47 2023] GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d => generated 1545 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 19:11:56 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-425111b9-107b-47e8-81df-4a5463b5ab74 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:56 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-425111b9-107b-47e8-81df-4a5463b5ab74 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:56 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:56 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=12 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-425111b9-107b-47e8-81df-4a5463b5ab74 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-425111b9-107b-47e8-81df-4a5463b5ab74 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-425111b9-107b-47e8-81df-4a5463b5ab74 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-425111b9-107b-47e8-81df-4a5463b5ab74 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-425111b9-107b-47e8-81df-4a5463b5ab74 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-425111b9-107b-47e8-81df-4a5463b5ab74 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:56 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-425111b9-107b-47e8-81df-4a5463b5ab74 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44f04fabef14935a4617dd452d3999b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8fe614f0541009788ffe685720634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:11:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-425111b9-107b-47e8-81df-4a5463b5ab74 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" status: 200 len: 1548 microversion: 2.1 time: 0.155068 Apr 13 19:11:56 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 211/636] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:11:56 2023] GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:11:58 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=5 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:58 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=5 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:11:58 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-35f2f198-58a9-45de-88aa-3dd20c2a5df8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:11:58 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-35f2f198-58a9-45de-88aa-3dd20c2a5df8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:11:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-35f2f198-58a9-45de-88aa-3dd20c2a5df8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-35f2f198-58a9-45de-88aa-3dd20c2a5df8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-35f2f198-58a9-45de-88aa-3dd20c2a5df8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-35f2f198-58a9-45de-88aa-3dd20c2a5df8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:11:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-35f2f198-58a9-45de-88aa-3dd20c2a5df8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:11:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-35f2f198-58a9-45de-88aa-3dd20c2a5df8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:11:58 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-35f2f198-58a9-45de-88aa-3dd20c2a5df8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:11:58 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-35f2f198-58a9-45de-88aa-3dd20c2a5df8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba" status: 200 len: 1537 microversion: 2.1 time: 0.193888 Apr 13 19:11:58 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 212/637] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:11:58 2023] GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba => generated 1537 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:12:10 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:10 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:10 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1de8d3d4-5e56-47be-993b-2598d9e833e0 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '.version_select at 0x7efe33d9fac0>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-1de8d3d4-5e56-47be-993b-2598d9e833e0 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/images/36e14854-8ca1-420d-8642-21ad4d51b5d6" status: 200 len: 1723 microversion: 2.1 time: 0.058132 Apr 13 19:12:11 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 215/638] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 19:12:10 2023] GET /compute/v2.1/images/36e14854-8ca1-420d-8642-21ad4d51b5d6 => generated 1723 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:12:11 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-148823fe-4e51-4129-a29a-293ae22c3e39 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '.version_select at 0x7efe33d5fc70>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:11 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:11 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:11 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-148823fe-4e51-4129-a29a-293ae22c3e39 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/images/36e14854-8ca1-420d-8642-21ad4d51b5d6" status: 200 len: 1723 microversion: 2.1 time: 0.107934 Apr 13 19:12:11 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 212/639] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 19:12:11 2023] GET /compute/v2.1/images/36e14854-8ca1-420d-8642-21ad4d51b5d6 => generated 1723 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:12:11 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c53355be-7c92-46e8-906e-707906fb5a9e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:11 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-c53355be-7c92-46e8-906e-707906fb5a9e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:12:11 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:11 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c53355be-7c92-46e8-906e-707906fb5a9e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c53355be-7c92-46e8-906e-707906fb5a9e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c53355be-7c92-46e8-906e-707906fb5a9e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c53355be-7c92-46e8-906e-707906fb5a9e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c53355be-7c92-46e8-906e-707906fb5a9e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c53355be-7c92-46e8-906e-707906fb5a9e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:11 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-c53355be-7c92-46e8-906e-707906fb5a9e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9282b733244da9bf210ddc66b74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1ef6e7b159468f90cfc0db2e8e904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:12:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-c53355be-7c92-46e8-906e-707906fb5a9e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d" status: 200 len: 1669 microversion: 2.1 time: 0.162488 Apr 13 19:12:11 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 213/640] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:12:11 2023] GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:12:17 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-720e7b03-d611-4c83-8a67-82ccf4ab00c9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Action: 'create', calling method: .version_select at 0x7efe33c8a680>, body: {"keypair": {"name": "tempest-keypair-1767392597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETrtalpYQPcSKz1Uvc8zhcl0TlkdLfnCDAYE9b0Gxj6dj83NAjoPt6+VcHDiCV3eWgdAtbJV8ZhOtBKhYZ+l/OE7pG32jVdqRo02bInWOOtIHlsQQihOwUoItSmHcTOUw=="}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:17 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-720e7b03-d611-4c83-8a67-82ccf4ab00c9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting quotas for project 42fbd7089a7e4ba8b2597fca0d8e84c8. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:12:17 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-720e7b03-d611-4c83-8a67-82ccf4ab00c9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting quotas for user 3bebf61a7401492692f9c60adde178f7 and project 42fbd7089a7e4ba8b2597fca0d8e84c8. Resources: {'key_pairs'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:12:17 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-720e7b03-d611-4c83-8a67-82ccf4ab00c9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057641 Apr 13 19:12:17 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 216/641] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:12:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-243833659", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f17efc87-567e-4354-9c6b-86094fabd53c"}], "security_groups": [{"name": "tempest-securitygroup--1745833116"}], "key_name": "tempest-keypair-1767392597", "user_data": "}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] validate_networks() for [('f17efc87-567e-4354-9c6b-86094fabd53c', None, None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting quotas for project 42fbd7089a7e4ba8b2597fca0d8e84c8. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting quotas for user 3bebf61a7401492692f9c60adde178f7 and project 42fbd7089a7e4ba8b2597fca0d8e84c8. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:12:19 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:12:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.563552 Apr 13 19:12:19 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 213/642] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:12:19 2023] POST /compute/v2.1/servers => generated 407 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:12:19 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d54c1ee7-caf0-4f4b-803a-83db41d722d0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:19 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-d54c1ee7-caf0-4f4b-803a-83db41d722d0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:12:19 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-d54c1ee7-caf0-4f4b-803a-83db41d722d0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:12:19 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-d54c1ee7-caf0-4f4b-803a-83db41d722d0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab" status: 200 len: 1239 microversion: 2.1 time: 0.065066 Apr 13 19:12:19 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 214/643] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:12:19 2023] GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:12:22 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:22 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] Creating event network-changed:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:12:22 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033085 Apr 13 19:12:22 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 217/644] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:12:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:24 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-7f806e26-b353-494a-a42a-44fdf5ad16e2 req-b7fb0529-3158-4495-a94f-ead3dd497e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-plugged", "status": "completed", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7f806e26-b353-494a-a42a-44fdf5ad16e2 req-b7fb0529-3158-4495-a94f-ead3dd497e38 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7f806e26-b353-494a-a42a-44fdf5ad16e2 req-b7fb0529-3158-4495-a94f-ead3dd497e38 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7f806e26-b353-494a-a42a-44fdf5ad16e2 req-b7fb0529-3158-4495-a94f-ead3dd497e38 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-7f806e26-b353-494a-a42a-44fdf5ad16e2 req-b7fb0529-3158-4495-a94f-ead3dd497e38 service nova] Creating event network-vif-plugged:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:12:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-7f806e26-b353-494a-a42a-44fdf5ad16e2 req-b7fb0529-3158-4495-a94f-ead3dd497e38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099549 Apr 13 19:12:24 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 214/645] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:12:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f0d824cd-86b7-4998-9725-d20bddea3662 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:25 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f0d824cd-86b7-4998-9725-d20bddea3662 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:12:25 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f0d824cd-86b7-4998-9725-d20bddea3662 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f0d824cd-86b7-4998-9725-d20bddea3662 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f0d824cd-86b7-4998-9725-d20bddea3662 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f0d824cd-86b7-4998-9725-d20bddea3662 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f0d824cd-86b7-4998-9725-d20bddea3662 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f0d824cd-86b7-4998-9725-d20bddea3662 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-f0d824cd-86b7-4998-9725-d20bddea3662 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] HTTP exception thrown: Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d could not be found. Apr 13 19:12:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f0d824cd-86b7-4998-9725-d20bddea3662 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Request method failure captured: Apr 13 19:12:25 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d HTTP/1.1 Apr 13 19:12:25 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:12:25 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:12:25 user devstack@n-api.service[61588]: Connection: close Apr 13 19:12:25 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:12:25 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:12:25 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:12:25 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:12:25 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFI-MIpNnS-TJhUw5FVssqoXE1_u-b4rA4wy20Qs6f8JhiujZfuUquehGyCa7r8448Gx4_6fciTBLys7U9XnVCvCievRK7BW2d7c9t18cfBSoQdHT6c2oRx-ai_oUU1951a4VGdPo4pLr-wjYQ3Mx2ZfIzZv77Hlk2pJl6fUBYQU7ME Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Project-Id: 3347c59f4ca945399a4323e689460d12 Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Project-Name: tempest-TestStampPattern-456915878 Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3347c59f4ca945399a4323e689460d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3347c59f4ca945399a4323e689460d12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3347c59f4ca945399a4323e689460d12"}]}] Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Tenant: tempest-TestStampPattern-456915878 Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Tenant-Id: 3347c59f4ca945399a4323e689460d12 Apr 13 19:12:25 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TestStampPattern-456915878 Apr 13 19:12:25 user devstack@n-api.service[61588]: X-User: tempest-TestStampPattern-456915878-project-member Apr 13 19:12:25 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:12:25 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:12:25 user devstack@n-api.service[61588]: X-User-Id: cb7bcc69770a4859904f1b66cece61e3 Apr 13 19:12:25 user devstack@n-api.service[61588]: X-User-Name: tempest-TestStampPattern-456915878-project-member Apr 13 19:12:25 user devstack@n-api.service[61588]: method: > Apr 13 19:12:25 user devstack@n-api.service[61588]: exception: Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d could not be found. Apr 13 19:12:25 user devstack@n-api.service[61588]: action_args: {'id': 'cb3fb753-ff8d-4dac-ab70-f940233bf25d'} Apr 13 19:12:25 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d could not be found. Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d could not be found. Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d could not be found. Apr 13 19:12:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:12:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f0d824cd-86b7-4998-9725-d20bddea3662 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Returning 404 to user: Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:12:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-f0d824cd-86b7-4998-9725-d20bddea3662 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d" status: 404 len: 111 microversion: 2.1 time: 0.035652 Apr 13 19:12:25 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 215/646] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:12:25 2023] GET /compute/v2.1/servers/cb3fb753-ff8d-4dac-ab70-f940233bf25d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:12:26 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-449cb9f0-d8a8-41a3-8e44-32b5adae7b9a req-dd93d454-0750-4b02-b444-bba0b92c9b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-plugged", "status": "completed", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:26 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-449cb9f0-d8a8-41a3-8e44-32b5adae7b9a req-dd93d454-0750-4b02-b444-bba0b92c9b26 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:26 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-449cb9f0-d8a8-41a3-8e44-32b5adae7b9a req-dd93d454-0750-4b02-b444-bba0b92c9b26 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:26 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-449cb9f0-d8a8-41a3-8e44-32b5adae7b9a req-dd93d454-0750-4b02-b444-bba0b92c9b26 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:26 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-449cb9f0-d8a8-41a3-8e44-32b5adae7b9a req-dd93d454-0750-4b02-b444-bba0b92c9b26 service nova] Creating event network-vif-plugged:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:12:26 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-449cb9f0-d8a8-41a3-8e44-32b5adae7b9a req-dd93d454-0750-4b02-b444-bba0b92c9b26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037098 Apr 13 19:12:26 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 218/647] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:12:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:28 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:28 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:12:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:28 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Going to try to terminate instance {{(pid=61589) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:12:29 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/635717f5-c514-41a7-b9dc-a03d699173c5" status: 204 len: 0 microversion: 2.1 time: 0.154947 Apr 13 19:12:29 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 215/648] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:12:28 2023] DELETE /compute/v2.1/servers/635717f5-c514-41a7-b9dc-a03d699173c5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:12:29 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-5f962183-7d5b-4c27-81a4-fc338aac6057 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:29 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-5f962183-7d5b-4c27-81a4-fc338aac6057 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:12:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5f962183-7d5b-4c27-81a4-fc338aac6057 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5f962183-7d5b-4c27-81a4-fc338aac6057 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5f962183-7d5b-4c27-81a4-fc338aac6057 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5f962183-7d5b-4c27-81a4-fc338aac6057 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5f962183-7d5b-4c27-81a4-fc338aac6057 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-5f962183-7d5b-4c27-81a4-fc338aac6057 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:29 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-5f962183-7d5b-4c27-81a4-fc338aac6057 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80063ed703d24a1b84aede724db205a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2877676ccbd0484d80ecabf3030c0ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:12:29 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-5f962183-7d5b-4c27-81a4-fc338aac6057 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/635717f5-c514-41a7-b9dc-a03d699173c5" status: 200 len: 1491 microversion: 2.1 time: 0.200654 Apr 13 19:12:29 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 216/649] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:12:29 2023] GET /compute/v2.1/servers/635717f5-c514-41a7-b9dc-a03d699173c5 => generated 1491 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:12:29 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:29 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-7acb478d-6f9f-4184-902e-35fb9fbcf9ce req-c67692cc-ee90-42da-bc63-233ec87f6f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635717f5-c514-41a7-b9dc-a03d699173c5", "name": "network-vif-unplugged", "status": "completed", "tag": "78f7925f-87b3-4251-90e4-aec51a11e4ec"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-7acb478d-6f9f-4184-902e-35fb9fbcf9ce req-c67692cc-ee90-42da-bc63-233ec87f6f64 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-7acb478d-6f9f-4184-902e-35fb9fbcf9ce req-c67692cc-ee90-42da-bc63-233ec87f6f64 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-7acb478d-6f9f-4184-902e-35fb9fbcf9ce req-c67692cc-ee90-42da-bc63-233ec87f6f64 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:29 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-7acb478d-6f9f-4184-902e-35fb9fbcf9ce req-c67692cc-ee90-42da-bc63-233ec87f6f64 service nova] Creating event network-vif-unplugged:78f7925f-87b3-4251-90e4-aec51a11e4ec for instance 635717f5-c514-41a7-b9dc-a03d699173c5 on user Apr 13 19:12:29 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-7acb478d-6f9f-4184-902e-35fb9fbcf9ce req-c67692cc-ee90-42da-bc63-233ec87f6f64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041422 Apr 13 19:12:29 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 219/650] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:12:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:29 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-2af3e330-63bb-4860-b828-8bc04027a3d9 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Calling method '.version_select at 0x7efe33d5eb00>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:29 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:29 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:30 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-2af3e330-63bb-4860-b828-8bc04027a3d9 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-550784019" status: 202 len: 0 microversion: 2.1 time: 0.030249 Apr 13 19:12:30 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 216/651] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 19:12:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-550784019 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:12:31 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635717f5-c514-41a7-b9dc-a03d699173c5", "name": "network-vif-plugged", "status": "completed", "tag": "78f7925f-87b3-4251-90e4-aec51a11e4ec"}, {"server_uuid": "635717f5-c514-41a7-b9dc-a03d699173c5", "name": "network-vif-plugged", "status": "completed", "tag": "78f7925f-87b3-4251-90e4-aec51a11e4ec"}, {"server_uuid": "635717f5-c514-41a7-b9dc-a03d699173c5", "name": "network-vif-plugged", "status": "completed", "tag": "78f7925f-87b3-4251-90e4-aec51a11e4ec"}, {"server_uuid": "635717f5-c514-41a7-b9dc-a03d699173c5", "name": "network-vif-plugged", "status": "completed", "tag": "78f7925f-87b3-4251-90e4-aec51a11e4ec"}, {"server_uuid": "635717f5-c514-41a7-b9dc-a03d699173c5", "name": "network-vif-deleted", "tag": "78f7925f-87b3-4251-90e4-aec51a11e4ec"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:31 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Creating event network-vif-plugged:78f7925f-87b3-4251-90e4-aec51a11e4ec for instance 635717f5-c514-41a7-b9dc-a03d699173c5 on user Apr 13 19:12:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Creating event network-vif-plugged:78f7925f-87b3-4251-90e4-aec51a11e4ec for instance 635717f5-c514-41a7-b9dc-a03d699173c5 on user Apr 13 19:12:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Creating event network-vif-plugged:78f7925f-87b3-4251-90e4-aec51a11e4ec for instance 635717f5-c514-41a7-b9dc-a03d699173c5 on user Apr 13 19:12:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Creating event network-vif-plugged:78f7925f-87b3-4251-90e4-aec51a11e4ec for instance 635717f5-c514-41a7-b9dc-a03d699173c5 on user Apr 13 19:12:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Creating event network-vif-deleted:78f7925f-87b3-4251-90e4-aec51a11e4ec for instance 635717f5-c514-41a7-b9dc-a03d699173c5 on user Apr 13 19:12:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.052779 Apr 13 19:12:31 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 217/652] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:12:31 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:48 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:48 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:48 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-5d6c0e0e-a721-4804-8dd9-16891a99ae96 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:48 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-5d6c0e0e-a721-4804-8dd9-16891a99ae96 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:12:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5d6c0e0e-a721-4804-8dd9-16891a99ae96 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5d6c0e0e-a721-4804-8dd9-16891a99ae96 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5d6c0e0e-a721-4804-8dd9-16891a99ae96 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5d6c0e0e-a721-4804-8dd9-16891a99ae96 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5d6c0e0e-a721-4804-8dd9-16891a99ae96 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5d6c0e0e-a721-4804-8dd9-16891a99ae96 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:48 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-5d6c0e0e-a721-4804-8dd9-16891a99ae96 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.123743 Apr 13 19:12:48 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 220/653] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 19:12:48 2023] GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/os-interface => generated 282 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:49 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:49 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:49 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d", "tag": "e124e179-0315-423a-b9cf-c232753845ed"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] Creating event network-changed:e124e179-0315-423a-b9cf-c232753845ed for instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d on user Apr 13 19:12:49 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=12 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:49 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=10 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:12:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051848 Apr 13 19:12:49 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 217/654] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:12:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:49 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-eab637ae-381b-45b2-a6ce-716841c1b870 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:49 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-eab637ae-381b-45b2-a6ce-716841c1b870 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:12:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eab637ae-381b-45b2-a6ce-716841c1b870 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eab637ae-381b-45b2-a6ce-716841c1b870 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eab637ae-381b-45b2-a6ce-716841c1b870 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eab637ae-381b-45b2-a6ce-716841c1b870 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eab637ae-381b-45b2-a6ce-716841c1b870 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eab637ae-381b-45b2-a6ce-716841c1b870 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:49 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-eab637ae-381b-45b2-a6ce-716841c1b870 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/ips" status: 200 len: 108 microversion: 2.1 time: 0.047867 Apr 13 19:12:49 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 218/655] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 19:12:49 2023] GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/ips => generated 108 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:50 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc03d2f5-5d25-4ada-bde0-5c2d270b60f7"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:50 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:12:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:50 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288184 Apr 13 19:12:50 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 221/656] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:12:50 2023] POST /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:51 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-580b7e5c-5cf9-4a55-8c78-0e0c31bb3cf0 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Action: 'create', calling method: .version_select at 0x7efe33eedc60>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1182290909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxycQUgxgvX4KrgSogh/FASMjBbt5FoL1Bm1OSdfsr2+D71mN0wUg1CoONDh6D08fd9G3ZLcmygPYoHkYKYM7UcbNhGrJakuHGCpIrB6MuMLJflBJ0+myyAMtN9XEOSGg=="}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:51 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-580b7e5c-5cf9-4a55-8c78-0e0c31bb3cf0 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Getting quotas for project a0b7cc9c0ba145bea0585e887a92c788. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:12:51 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-580b7e5c-5cf9-4a55-8c78-0e0c31bb3cf0 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Getting quotas for user 60dea69daeb2475f84b5a46821288be9 and project a0b7cc9c0ba145bea0585e887a92c788. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:12:51 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-580b7e5c-5cf9-4a55-8c78-0e0c31bb3cf0 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.271283 Apr 13 19:12:51 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 218/657] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:12:51 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:52 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-56826252", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1182290909", "security_groups": [{"name": "tempest-secgroup-smoke-569620059"}], "networks": [{"uuid": "f73b1428-f00d-4eeb-91eb-d5c99ee34946"}]}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:52 user devstack@n-api.service[61588]: DEBUG nova.network.neutron [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] validate_networks() for [('f73b1428-f00d-4eeb-91eb-d5c99ee34946', None, None, None, None, None)] {{(pid=61588) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Flavor limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Image limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Flavor pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Image pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Getting quotas for project a0b7cc9c0ba145bea0585e887a92c788. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Getting quotas for user 60dea69daeb2475f84b5a46821288be9 and project a0b7cc9c0ba145bea0585e887a92c788. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Going to run 1 instances... {{(pid=61588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:12:53 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:12:53 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.535451 Apr 13 19:12:53 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 219/658] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:12:52 2023] POST /compute/v2.1/servers => generated 403 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:12:53 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-f99dc42b-5f4c-462b-bc9b-cb82302dadac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:53 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-f99dc42b-5f4c-462b-bc9b-cb82302dadac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:12:53 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-f99dc42b-5f4c-462b-bc9b-cb82302dadac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dea69daeb2475f84b5a46821288be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b7cc9c0ba145bea0585e887a92c788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:12:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-f99dc42b-5f4c-462b-bc9b-cb82302dadac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac" status: 200 len: 1255 microversion: 2.1 time: 0.084291 Apr 13 19:12:53 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 222/659] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:12:53 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac => generated 1255 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:12:55 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080204b2-fd4d-4224-b391-a27036d058ac", "tag": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:55 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] Creating event network-changed:a29956b4-c9c2-4c86-bf4a-488fb5f45af0 for instance 080204b2-fd4d-4224-b391-a27036d058ac on user Apr 13 19:12:55 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033385 Apr 13 19:12:55 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 219/660] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:12:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:57 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:57 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:12:57 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:57 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:57 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:57 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:57 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:57 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:57 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:12:57 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:57 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:57 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] Creating event network-changed:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:12:57 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101237 Apr 13 19:12:57 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 223/661] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:12:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:57 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" status: 204 len: 0 microversion: 2.1 time: 0.130404 Apr 13 19:12:57 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 220/662] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:12:57 2023] DELETE /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:12:57 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ffab9d6e-788e-41e6-9101-f4af448c8461 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:57 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ffab9d6e-788e-41e6-9101-f4af448c8461 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:12:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ffab9d6e-788e-41e6-9101-f4af448c8461 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ffab9d6e-788e-41e6-9101-f4af448c8461 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ffab9d6e-788e-41e6-9101-f4af448c8461 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ffab9d6e-788e-41e6-9101-f4af448c8461 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ffab9d6e-788e-41e6-9101-f4af448c8461 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:57 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ffab9d6e-788e-41e6-9101-f4af448c8461 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:57 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-ffab9d6e-788e-41e6-9101-f4af448c8461 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44f04fabef14935a4617dd452d3999b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8fe614f0541009788ffe685720634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:12:57 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ffab9d6e-788e-41e6-9101-f4af448c8461 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" status: 200 len: 1554 microversion: 2.1 time: 0.217308 Apr 13 19:12:57 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 220/663] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:12:57 2023] GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => generated 1554 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:12:58 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-ca80d722-2a66-4228-81a8-e0588616011f req-00963705-3601-4cc7-8165-676cf9e7383f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080204b2-fd4d-4224-b391-a27036d058ac", "name": "network-vif-plugged", "status": "completed", "tag": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-ca80d722-2a66-4228-81a8-e0588616011f req-00963705-3601-4cc7-8165-676cf9e7383f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-ca80d722-2a66-4228-81a8-e0588616011f req-00963705-3601-4cc7-8165-676cf9e7383f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-ca80d722-2a66-4228-81a8-e0588616011f req-00963705-3601-4cc7-8165-676cf9e7383f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:58 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-ca80d722-2a66-4228-81a8-e0588616011f req-00963705-3601-4cc7-8165-676cf9e7383f service nova] Creating event network-vif-plugged:a29956b4-c9c2-4c86-bf4a-488fb5f45af0 for instance 080204b2-fd4d-4224-b391-a27036d058ac on user Apr 13 19:12:58 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-ca80d722-2a66-4228-81a8-e0588616011f req-00963705-3601-4cc7-8165-676cf9e7383f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048230 Apr 13 19:12:58 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 224/664] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:12:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:58 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-28e80211-e123-4420-80da-944af9e0458d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: .version_select at 0x7efe383d2ef0>, body: {"keypair": {"name": "tempest-keypair-701851917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvx+NdVaRzGRxiQY+XYoIW6YuPWvMsgN7CXZ0pBdpM8XxJvUcI0Aw9ztA/htv8tlmF0ErI6crkAH0Uw9JA9IEn3VjvSl6uTMrNFJqI5sjQP4v1MscAIBS4R6Qf+HcOgZQ=="}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:58 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-28e80211-e123-4420-80da-944af9e0458d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'key_pairs'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:12:58 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-28e80211-e123-4420-80da-944af9e0458d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for user 975d5fe9f1e445f0ba1be8fc71e93ecc and project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'key_pairs'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:12:58 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-28e80211-e123-4420-80da-944af9e0458d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060304 Apr 13 19:12:58 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 221/665] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:12:58 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:58 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-17826253-f366-4cb0-be4a-3570863a02a2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:12:58 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-17826253-f366-4cb0-be4a-3570863a02a2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:12:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-17826253-f366-4cb0-be4a-3570863a02a2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-17826253-f366-4cb0-be4a-3570863a02a2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-17826253-f366-4cb0-be4a-3570863a02a2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-17826253-f366-4cb0-be4a-3570863a02a2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-17826253-f366-4cb0-be4a-3570863a02a2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-17826253-f366-4cb0-be4a-3570863a02a2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:58 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-17826253-f366-4cb0-be4a-3570863a02a2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.285110 Apr 13 19:12:58 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 221/666] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 19:12:58 2023] GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba/os-interface => generated 282 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:12:59 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "name": "network-vif-unplugged", "status": "completed", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}, {"server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "name": "network-vif-plugged", "status": "completed", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:12:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:12:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:12:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:12:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] Creating event network-vif-unplugged:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:12:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] Creating event network-vif-plugged:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:12:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032368 Apr 13 19:12:59 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 225/667] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:12:59 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:00 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080204b2-fd4d-4224-b391-a27036d058ac", "name": "network-vif-plugged", "status": "completed", "tag": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0"}, {"server_uuid": "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333", "name": "network-vif-deleted", "tag": "8640b481-7480-494b-a88b-e21419d695cf"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:00 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] Creating event network-vif-plugged:a29956b4-c9c2-4c86-bf4a-488fb5f45af0 for instance 080204b2-fd4d-4224-b391-a27036d058ac on user Apr 13 19:13:00 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] Creating event network-vif-deleted:8640b481-7480-494b-a88b-e21419d695cf for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 on user Apr 13 19:13:00 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049875 Apr 13 19:13:00 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 222/668] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:00 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1026578346", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c6740647-dbe4-4a73-ada4-b154eca2af81"}], "security_groups": [{"name": "tempest-securitygroup--950408674"}], "key_name": "tempest-keypair-701851917", "user_data": "}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:00 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] validate_networks() for [('c6740647-dbe4-4a73-ada4-b154eca2af81', None, None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for user 975d5fe9f1e445f0ba1be8fc71e93ecc and project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:13:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579c83e7-7976-47f4-9f25-a194e39966ba", "tag": "ab959649-556a-479c-9e13-ec36fb9ebb66"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:01 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:13:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] Creating event network-changed:ab959649-556a-479c-9e13-ec36fb9ebb66 for instance 579c83e7-7976-47f4-9f25-a194e39966ba on user Apr 13 19:13:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050934 Apr 13 19:13:01 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 226/669] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:01 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.753314 Apr 13 19:13:01 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 222/670] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:13:00 2023] POST /compute/v2.1/servers => generated 399 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:13:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-694bfb5d-153f-4d7a-9b0b-94a797962603 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:13:01 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-694bfb5d-153f-4d7a-9b0b-94a797962603 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:01 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-694bfb5d-153f-4d7a-9b0b-94a797962603 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:13:01 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-694bfb5d-153f-4d7a-9b0b-94a797962603 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8" status: 200 len: 1235 microversion: 2.1 time: 0.091995 Apr 13 19:13:01 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 223/671] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:13:01 2023] GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8 => generated 1235 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:13:03 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:03 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1898726378", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f"}], "security_groups": [{"name": "tempest-securitygroup--1715513541"}], "key_name": "tempest-keypair-479347877", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "7cde3ec4-f279-44f2-927c-45ce0d350ca2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:03 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] validate_networks() for [('53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:13:04 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d7439c2-317e-4454-905f-dc8e59bc49e8", "tag": "2df65aa5-af8b-4d51-8246-ed31a3e0219e"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:04 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] Creating event network-changed:2df65aa5-af8b-4d51-8246-ed31a3e0219e for instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 on user Apr 13 19:13:04 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039189 Apr 13 19:13:04 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 223/672] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for project c162f91cba4b4ecf9de48fbf839da261. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for user df209814208d415e9d414d39205aaad6 and project c162f91cba4b4ecf9de48fbf839da261. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:13:04 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7cde3ec4-f279-44f2-927c-45ce0d350ca2',volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:13:04 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.846561 Apr 13 19:13:04 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 227/673] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:13:03 2023] POST /compute/v2.1/servers => generated 404 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:13:04 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f89fd205-a2f3-453e-84d4-95b886bbaada tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:13:04 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f89fd205-a2f3-453e-84d4-95b886bbaada tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:04 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:04 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-f89fd205-a2f3-453e-84d4-95b886bbaada tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:13:04 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-f89fd205-a2f3-453e-84d4-95b886bbaada tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 200 len: 1075 microversion: 2.1 time: 0.083695 Apr 13 19:13:04 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 224/674] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:13:04 2023] GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 1075 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:13:06 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-41d9fbfe-b0d7-464c-8a14-88de85d1f1e1 req-a4eb6a41-55d0-4a54-a08e-1d66908622be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d7439c2-317e-4454-905f-dc8e59bc49e8", "name": "network-vif-plugged", "status": "completed", "tag": "2df65aa5-af8b-4d51-8246-ed31a3e0219e"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-41d9fbfe-b0d7-464c-8a14-88de85d1f1e1 req-a4eb6a41-55d0-4a54-a08e-1d66908622be service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-41d9fbfe-b0d7-464c-8a14-88de85d1f1e1 req-a4eb6a41-55d0-4a54-a08e-1d66908622be service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-41d9fbfe-b0d7-464c-8a14-88de85d1f1e1 req-a4eb6a41-55d0-4a54-a08e-1d66908622be service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:06 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-41d9fbfe-b0d7-464c-8a14-88de85d1f1e1 req-a4eb6a41-55d0-4a54-a08e-1d66908622be service nova] Creating event network-vif-plugged:2df65aa5-af8b-4d51-8246-ed31a3e0219e for instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 on user Apr 13 19:13:06 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-41d9fbfe-b0d7-464c-8a14-88de85d1f1e1 req-a4eb6a41-55d0-4a54-a08e-1d66908622be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035405 Apr 13 19:13:06 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 224/675] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:08 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d7439c2-317e-4454-905f-dc8e59bc49e8", "name": "network-vif-plugged", "status": "completed", "tag": "2df65aa5-af8b-4d51-8246-ed31a3e0219e"}, {"name": "network-changed", "server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:08 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] Creating event network-vif-plugged:2df65aa5-af8b-4d51-8246-ed31a3e0219e for instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 on user Apr 13 19:13:08 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] Creating event network-changed:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:13:08 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039057 Apr 13 19:13:08 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 228/676] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:08 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d705c3ed-20bf-47c6-93ca-b29edd342194 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:13:09 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-d705c3ed-20bf-47c6-93ca-b29edd342194 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d705c3ed-20bf-47c6-93ca-b29edd342194 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d705c3ed-20bf-47c6-93ca-b29edd342194 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d705c3ed-20bf-47c6-93ca-b29edd342194 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d705c3ed-20bf-47c6-93ca-b29edd342194 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d705c3ed-20bf-47c6-93ca-b29edd342194 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d705c3ed-20bf-47c6-93ca-b29edd342194 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:09 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-d705c3ed-20bf-47c6-93ca-b29edd342194 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:13:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-d705c3ed-20bf-47c6-93ca-b29edd342194 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab" status: 200 len: 1553 microversion: 2.1 time: 0.165281 Apr 13 19:13:09 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 225/677] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:13:09 2023] GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:13:11 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:11 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=10 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:11 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-40433706-3820-471c-a908-674481cd5d42 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:13:11 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-40433706-3820-471c-a908-674481cd5d42 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-40433706-3820-471c-a908-674481cd5d42 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-40433706-3820-471c-a908-674481cd5d42 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-40433706-3820-471c-a908-674481cd5d42 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-40433706-3820-471c-a908-674481cd5d42 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-40433706-3820-471c-a908-674481cd5d42 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-40433706-3820-471c-a908-674481cd5d42 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:11 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-40433706-3820-471c-a908-674481cd5d42 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9282b733244da9bf210ddc66b74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1ef6e7b159468f90cfc0db2e8e904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:13:11 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-40433706-3820-471c-a908-674481cd5d42 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d" status: 200 len: 1669 microversion: 2.1 time: 0.175865 Apr 13 19:13:11 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 225/678] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:13:11 2023] GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d => generated 1669 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:13:13 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:13 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:13 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "POST /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343745 Apr 13 19:13:13 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 229/679] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:13:13 2023] POST /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:13 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-b0b549b9-edd5-4327-ae1d-dbf30a812641 req-578cd6f5-4dd8-4e20-804d-820b0021b919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-plugged", "status": "completed", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b0b549b9-edd5-4327-ae1d-dbf30a812641 req-578cd6f5-4dd8-4e20-804d-820b0021b919 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b0b549b9-edd5-4327-ae1d-dbf30a812641 req-578cd6f5-4dd8-4e20-804d-820b0021b919 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b0b549b9-edd5-4327-ae1d-dbf30a812641 req-578cd6f5-4dd8-4e20-804d-820b0021b919 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:13 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-b0b549b9-edd5-4327-ae1d-dbf30a812641 req-578cd6f5-4dd8-4e20-804d-820b0021b919 service nova] Creating event network-vif-plugged:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:13:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-b0b549b9-edd5-4327-ae1d-dbf30a812641 req-578cd6f5-4dd8-4e20-804d-820b0021b919 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030630 Apr 13 19:13:14 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 226/680] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:16 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-ccb2e602-1a5c-47d0-8b00-3b92d29cf296 req-08414d24-3a72-4626-a922-7e907d843f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-plugged", "status": "completed", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ccb2e602-1a5c-47d0-8b00-3b92d29cf296 req-08414d24-3a72-4626-a922-7e907d843f43 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ccb2e602-1a5c-47d0-8b00-3b92d29cf296 req-08414d24-3a72-4626-a922-7e907d843f43 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ccb2e602-1a5c-47d0-8b00-3b92d29cf296 req-08414d24-3a72-4626-a922-7e907d843f43 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-ccb2e602-1a5c-47d0-8b00-3b92d29cf296 req-08414d24-3a72-4626-a922-7e907d843f43 service nova] Creating event network-vif-plugged:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:13:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-ccb2e602-1a5c-47d0-8b00-3b92d29cf296 req-08414d24-3a72-4626-a922-7e907d843f43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030336 Apr 13 19:13:16 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 226/681] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a922bd94-8509-479d-862c-f17f7534c49f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-a922bd94-8509-479d-862c-f17f7534c49f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a922bd94-8509-479d-862c-f17f7534c49f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a922bd94-8509-479d-862c-f17f7534c49f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a922bd94-8509-479d-862c-f17f7534c49f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a922bd94-8509-479d-862c-f17f7534c49f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a922bd94-8509-479d-862c-f17f7534c49f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a922bd94-8509-479d-862c-f17f7534c49f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-a922bd94-8509-479d-862c-f17f7534c49f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] HTTP exception thrown: Instance 635717f5-c514-41a7-b9dc-a03d699173c5 could not be found. Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a922bd94-8509-479d-862c-f17f7534c49f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Request method failure captured: Apr 13 19:13:19 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/635717f5-c514-41a7-b9dc-a03d699173c5 HTTP/1.1 Apr 13 19:13:19 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:13:19 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:13:19 user devstack@n-api.service[61587]: Connection: close Apr 13 19:13:19 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:13:19 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:13:19 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:13:19 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:13:19 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFOrtpkdTwN-eRNohkLT0R_6qbVcy5YK4REy5WI66HMemUHPPYK_UjZwykxIqEOuiXC_tP-Ve8odYZ71PMqjc-cBmD9TLLkV7krUqOECFxtj2qSDRTcR1x9gqH1Wp3u97vYjR-AxIbidsSzvqQDbNZwYJjKOSS46TXWAayGYGBJ0Wz4 Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Project-Id: 2877676ccbd0484d80ecabf3030c0ee4 Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Project-Name: tempest-VolumesActionsTest-427747232 Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2877676ccbd0484d80ecabf3030c0ee4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2877676ccbd0484d80ecabf3030c0ee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2877676ccbd0484d80ecabf3030c0ee4"}]}] Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Tenant: tempest-VolumesActionsTest-427747232 Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Tenant-Id: 2877676ccbd0484d80ecabf3030c0ee4 Apr 13 19:13:19 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-VolumesActionsTest-427747232 Apr 13 19:13:19 user devstack@n-api.service[61587]: X-User: tempest-VolumesActionsTest-427747232-project-member Apr 13 19:13:19 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:13:19 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:13:19 user devstack@n-api.service[61587]: X-User-Id: 80063ed703d24a1b84aede724db205a7 Apr 13 19:13:19 user devstack@n-api.service[61587]: X-User-Name: tempest-VolumesActionsTest-427747232-project-member Apr 13 19:13:19 user devstack@n-api.service[61587]: method: > Apr 13 19:13:19 user devstack@n-api.service[61587]: exception: Instance 635717f5-c514-41a7-b9dc-a03d699173c5 could not be found. Apr 13 19:13:19 user devstack@n-api.service[61587]: action_args: {'id': '635717f5-c514-41a7-b9dc-a03d699173c5'} Apr 13 19:13:19 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635717f5-c514-41a7-b9dc-a03d699173c5 could not be found. Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635717f5-c514-41a7-b9dc-a03d699173c5 could not be found. Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635717f5-c514-41a7-b9dc-a03d699173c5 could not be found. Apr 13 19:13:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:13:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a922bd94-8509-479d-862c-f17f7534c49f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Returning 404 to user: Instance 635717f5-c514-41a7-b9dc-a03d699173c5 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:13:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a922bd94-8509-479d-862c-f17f7534c49f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/635717f5-c514-41a7-b9dc-a03d699173c5" status: 404 len: 111 microversion: 2.1 time: 0.043101 Apr 13 19:13:19 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 230/682] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:13:19 2023] GET /compute/v2.1/servers/635717f5-c514-41a7-b9dc-a03d699173c5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=14 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1162697425", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "b34bf81f-6825-4376-a26c-35386631a4ad"}]}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG nova.network.neutron [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] validate_networks() for [('b34bf81f-6825-4376-a26c-35386631a4ad', None, None, None, None, None)] {{(pid=61588) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Flavor limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Image limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Flavor pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Image pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Getting quotas for project 2877676ccbd0484d80ecabf3030c0ee4. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Getting quotas for user 80063ed703d24a1b84aede724db205a7 and project 2877676ccbd0484d80ecabf3030c0ee4. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Going to run 1 instances... {{(pid=61588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:13:19 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:13:20 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.586891 Apr 13 19:13:20 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 227/683] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:13:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 13 19:13:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e15c6b1d-3fa5-4cc7-a4a7-9d4582c7a9c3 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:13:20 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e15c6b1d-3fa5-4cc7-a4a7-9d4582c7a9c3 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:20 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:20 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-e15c6b1d-3fa5-4cc7-a4a7-9d4582c7a9c3 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80063ed703d24a1b84aede724db205a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2877676ccbd0484d80ecabf3030c0ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:13:20 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e15c6b1d-3fa5-4cc7-a4a7-9d4582c7a9c3 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9428f3f-1910-421d-be9c-7ca42fa46334" status: 200 len: 1208 microversion: 2.1 time: 0.095278 Apr 13 19:13:20 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 227/684] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:13:20 2023] GET /compute/v2.1/servers/e9428f3f-1910-421d-be9c-7ca42fa46334 => generated 1208 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:13:21 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "36e14854-8ca1-420d-8642-21ad4d51b5d6"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:21 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:21 user devstack@n-api.service[61587]: DEBUG nova.objects.instance [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'flavor' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=61587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:13:21 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "POST /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/action" status: 200 len: 29 microversion: 2.1 time: 0.233240 Apr 13 19:13:21 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 231/685] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:13:21 2023] POST /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/action => generated 29 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:13:21 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-233b97aa-96cc-49c1-a40d-5a03b645b678 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:13:21 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-233b97aa-96cc-49c1-a40d-5a03b645b678 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-233b97aa-96cc-49c1-a40d-5a03b645b678 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-233b97aa-96cc-49c1-a40d-5a03b645b678 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-233b97aa-96cc-49c1-a40d-5a03b645b678 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-233b97aa-96cc-49c1-a40d-5a03b645b678 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-233b97aa-96cc-49c1-a40d-5a03b645b678 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-233b97aa-96cc-49c1-a40d-5a03b645b678 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:21 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-233b97aa-96cc-49c1-a40d-5a03b645b678 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9282b733244da9bf210ddc66b74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1ef6e7b159468f90cfc0db2e8e904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:13:21 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-233b97aa-96cc-49c1-a40d-5a03b645b678 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d" status: 200 len: 1721 microversion: 2.1 time: 0.214766 Apr 13 19:13:21 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 228/686] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:13:21 2023] GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:13:22 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-ee086c6a-38b9-450e-96ab-a8ce7153c242 req-5bcd8fde-f070-4f09-90ee-2e3ec563c479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-unplugged", "status": "completed", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ee086c6a-38b9-450e-96ab-a8ce7153c242 req-5bcd8fde-f070-4f09-90ee-2e3ec563c479 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ee086c6a-38b9-450e-96ab-a8ce7153c242 req-5bcd8fde-f070-4f09-90ee-2e3ec563c479 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ee086c6a-38b9-450e-96ab-a8ce7153c242 req-5bcd8fde-f070-4f09-90ee-2e3ec563c479 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:22 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=29 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:22 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-ee086c6a-38b9-450e-96ab-a8ce7153c242 req-5bcd8fde-f070-4f09-90ee-2e3ec563c479 service nova] Creating event network-vif-unplugged:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:13:22 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-ee086c6a-38b9-450e-96ab-a8ce7153c242 req-5bcd8fde-f070-4f09-90ee-2e3ec563c479 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094250 Apr 13 19:13:22 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 228/687] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:22 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9428f3f-1910-421d-be9c-7ca42fa46334", "tag": "06aa9cb5-cf77-482a-8292-b82631f08459"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:23 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:23 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] Creating event network-changed:06aa9cb5-cf77-482a-8292-b82631f08459 for instance e9428f3f-1910-421d-be9c-7ca42fa46334 on user Apr 13 19:13:23 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031322 Apr 13 19:13:23 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 232/688] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-66ff5f72-cb64-49e3-a8d9-84e9296e6791 req-49cda7b2-c700-4f67-a650-ddf02210588f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-plugged", "status": "completed", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-66ff5f72-cb64-49e3-a8d9-84e9296e6791 req-49cda7b2-c700-4f67-a650-ddf02210588f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-66ff5f72-cb64-49e3-a8d9-84e9296e6791 req-49cda7b2-c700-4f67-a650-ddf02210588f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-66ff5f72-cb64-49e3-a8d9-84e9296e6791 req-49cda7b2-c700-4f67-a650-ddf02210588f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-66ff5f72-cb64-49e3-a8d9-84e9296e6791 req-49cda7b2-c700-4f67-a650-ddf02210588f service nova] Creating event network-vif-plugged:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:13:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-66ff5f72-cb64-49e3-a8d9-84e9296e6791 req-49cda7b2-c700-4f67-a650-ddf02210588f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028420 Apr 13 19:13:24 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 229/689] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-364758d8-145b-420a-a3ea-7e6b2cd6b605 req-3ce60001-4ad5-46f6-9643-a6736fc3ed19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9428f3f-1910-421d-be9c-7ca42fa46334", "name": "network-vif-plugged", "status": "completed", "tag": "06aa9cb5-cf77-482a-8292-b82631f08459"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-364758d8-145b-420a-a3ea-7e6b2cd6b605 req-3ce60001-4ad5-46f6-9643-a6736fc3ed19 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-364758d8-145b-420a-a3ea-7e6b2cd6b605 req-3ce60001-4ad5-46f6-9643-a6736fc3ed19 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-364758d8-145b-420a-a3ea-7e6b2cd6b605 req-3ce60001-4ad5-46f6-9643-a6736fc3ed19 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-364758d8-145b-420a-a3ea-7e6b2cd6b605 req-3ce60001-4ad5-46f6-9643-a6736fc3ed19 service nova] Creating event network-vif-plugged:06aa9cb5-cf77-482a-8292-b82631f08459 for instance e9428f3f-1910-421d-be9c-7ca42fa46334 on user Apr 13 19:13:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-364758d8-145b-420a-a3ea-7e6b2cd6b605 req-3ce60001-4ad5-46f6-9643-a6736fc3ed19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030483 Apr 13 19:13:25 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 229/690] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:27 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-2d7fd032-36ba-4bcd-9d05-33a671d97419 req-f1de6ffe-152e-4d4d-913f-d0aa3ee172b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-plugged", "status": "completed", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2d7fd032-36ba-4bcd-9d05-33a671d97419 req-f1de6ffe-152e-4d4d-913f-d0aa3ee172b9 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2d7fd032-36ba-4bcd-9d05-33a671d97419 req-f1de6ffe-152e-4d4d-913f-d0aa3ee172b9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2d7fd032-36ba-4bcd-9d05-33a671d97419 req-f1de6ffe-152e-4d4d-913f-d0aa3ee172b9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:27 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-2d7fd032-36ba-4bcd-9d05-33a671d97419 req-f1de6ffe-152e-4d4d-913f-d0aa3ee172b9 service nova] Creating event network-vif-plugged:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:13:27 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-2d7fd032-36ba-4bcd-9d05-33a671d97419 req-f1de6ffe-152e-4d4d-913f-d0aa3ee172b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047472 Apr 13 19:13:27 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 233/691] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-14e96bce-4059-4603-8b20-d74e6b3d896e req-7a5773d8-f25a-49da-8628-771571a82423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9428f3f-1910-421d-be9c-7ca42fa46334", "name": "network-vif-plugged", "status": "completed", "tag": "06aa9cb5-cf77-482a-8292-b82631f08459"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-14e96bce-4059-4603-8b20-d74e6b3d896e req-7a5773d8-f25a-49da-8628-771571a82423 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-14e96bce-4059-4603-8b20-d74e6b3d896e req-7a5773d8-f25a-49da-8628-771571a82423 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-14e96bce-4059-4603-8b20-d74e6b3d896e req-7a5773d8-f25a-49da-8628-771571a82423 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-14e96bce-4059-4603-8b20-d74e6b3d896e req-7a5773d8-f25a-49da-8628-771571a82423 service nova] Creating event network-vif-plugged:06aa9cb5-cf77-482a-8292-b82631f08459 for instance e9428f3f-1910-421d-be9c-7ca42fa46334 on user Apr 13 19:13:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-14e96bce-4059-4603-8b20-d74e6b3d896e req-7a5773d8-f25a-49da-8628-771571a82423 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032834 Apr 13 19:13:28 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 230/692] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:30 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-9d43f7b4-5d14-4726-a653-5285fbdb954d req-1fc717c5-7c7c-4731-8e1e-fa8c1b6e4475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-plugged", "status": "completed", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:13:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9d43f7b4-5d14-4726-a653-5285fbdb954d req-1fc717c5-7c7c-4731-8e1e-fa8c1b6e4475 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9d43f7b4-5d14-4726-a653-5285fbdb954d req-1fc717c5-7c7c-4731-8e1e-fa8c1b6e4475 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9d43f7b4-5d14-4726-a653-5285fbdb954d req-1fc717c5-7c7c-4731-8e1e-fa8c1b6e4475 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:30 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-9d43f7b4-5d14-4726-a653-5285fbdb954d req-1fc717c5-7c7c-4731-8e1e-fa8c1b6e4475 service nova] Creating event network-vif-plugged:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:13:30 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-9d43f7b4-5d14-4726-a653-5285fbdb954d req-1fc717c5-7c7c-4731-8e1e-fa8c1b6e4475 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029002 Apr 13 19:13:30 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 230/693] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:13:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:13:43 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=7 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:43 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:43 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-9c98fb45-b7cb-4342-bc26-c9c50a54fe7c tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:13:43 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-9c98fb45-b7cb-4342-bc26-c9c50a54fe7c tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9c98fb45-b7cb-4342-bc26-c9c50a54fe7c tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9c98fb45-b7cb-4342-bc26-c9c50a54fe7c tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9c98fb45-b7cb-4342-bc26-c9c50a54fe7c tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9c98fb45-b7cb-4342-bc26-c9c50a54fe7c tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9c98fb45-b7cb-4342-bc26-c9c50a54fe7c tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9c98fb45-b7cb-4342-bc26-c9c50a54fe7c tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:43 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-9c98fb45-b7cb-4342-bc26-c9c50a54fe7c tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dea69daeb2475f84b5a46821288be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b7cc9c0ba145bea0585e887a92c788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:13:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-9c98fb45-b7cb-4342-bc26-c9c50a54fe7c tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac" status: 200 len: 1565 microversion: 2.1 time: 0.161996 Apr 13 19:13:43 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 234/694] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:13:43 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=11 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-dfffa9b9-0644-4a78-8276-af13af35fa35 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-dfffa9b9-0644-4a78-8276-af13af35fa35 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dfffa9b9-0644-4a78-8276-af13af35fa35 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dfffa9b9-0644-4a78-8276-af13af35fa35 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dfffa9b9-0644-4a78-8276-af13af35fa35 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dfffa9b9-0644-4a78-8276-af13af35fa35 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dfffa9b9-0644-4a78-8276-af13af35fa35 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dfffa9b9-0644-4a78-8276-af13af35fa35 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-dfffa9b9-0644-4a78-8276-af13af35fa35 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] HTTP exception thrown: Instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 could not be found. Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-dfffa9b9-0644-4a78-8276-af13af35fa35 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Request method failure captured: Apr 13 19:13:47 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 HTTP/1.1 Apr 13 19:13:47 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:13:47 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:13:47 user devstack@n-api.service[61588]: Connection: close Apr 13 19:13:47 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:13:47 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:13:47 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:13:47 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:13:47 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFLf70BnEfyTVf4WLz7flhCv4WgcqgUiwR7Z7UJ9tNuLya18In61eLvOv6VTYi5HJ-HHYC_meGEcr5pfvTWGnmeyc4lNLtkBC8EHmKWSI7jbaaQpOmDtKNlrin3JE-ZFpxOqZIddQ8KGOTns8hTCRAXwFRK5ue27RAZb2BPbPPMLfdA Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Project-Id: 20b8fe614f0541009788ffe685720634 Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Project-Name: tempest-TestShelveInstance-1512441304 Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8fe614f0541009788ffe685720634"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20b8fe614f0541009788ffe685720634"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20b8fe614f0541009788ffe685720634"}]}] Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Tenant: tempest-TestShelveInstance-1512441304 Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Tenant-Id: 20b8fe614f0541009788ffe685720634 Apr 13 19:13:47 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TestShelveInstance-1512441304 Apr 13 19:13:47 user devstack@n-api.service[61588]: X-User: tempest-TestShelveInstance-1512441304-project-member Apr 13 19:13:47 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:13:47 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:13:47 user devstack@n-api.service[61588]: X-User-Id: e44f04fabef14935a4617dd452d3999b Apr 13 19:13:47 user devstack@n-api.service[61588]: X-User-Name: tempest-TestShelveInstance-1512441304-project-member Apr 13 19:13:47 user devstack@n-api.service[61588]: method: > Apr 13 19:13:47 user devstack@n-api.service[61588]: exception: Instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 could not be found. Apr 13 19:13:47 user devstack@n-api.service[61588]: action_args: {'id': '8c60e6c0-533c-4fd3-938f-b9ecc9fb0333'} Apr 13 19:13:47 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 could not be found. Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 could not be found. Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 could not be found. Apr 13 19:13:47 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:13:47 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-dfffa9b9-0644-4a78-8276-af13af35fa35 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Returning 404 to user: Instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:13:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-dfffa9b9-0644-4a78-8276-af13af35fa35 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" status: 404 len: 111 microversion: 2.1 time: 0.036639 Apr 13 19:13:47 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 231/695] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:13:47 2023] GET /compute/v2.1/servers/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:13:47 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:47 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=9 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:47 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=5 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:13:47 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7d2ca40b-4461-4efb-b5ff-62685afeb99e tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Calling method '.version_select at 0x7efe33db00d0>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:13:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7d2ca40b-4461-4efb-b5ff-62685afeb99e tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-24428880" status: 202 len: 0 microversion: 2.1 time: 0.029738 Apr 13 19:13:47 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 231/696] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 19:13:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-24428880 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:13:51 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-deea95ec-e4e9-43f7-89f4-ae6f08e3a17f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:13:51 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-deea95ec-e4e9-43f7-89f4-ae6f08e3a17f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-deea95ec-e4e9-43f7-89f4-ae6f08e3a17f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-deea95ec-e4e9-43f7-89f4-ae6f08e3a17f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-deea95ec-e4e9-43f7-89f4-ae6f08e3a17f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-deea95ec-e4e9-43f7-89f4-ae6f08e3a17f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-deea95ec-e4e9-43f7-89f4-ae6f08e3a17f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-deea95ec-e4e9-43f7-89f4-ae6f08e3a17f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:51 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-deea95ec-e4e9-43f7-89f4-ae6f08e3a17f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:13:51 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-deea95ec-e4e9-43f7-89f4-ae6f08e3a17f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8" status: 200 len: 1545 microversion: 2.1 time: 0.215220 Apr 13 19:13:51 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 235/697] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:13:51 2023] GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8 => generated 1545 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:13:54 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-6525d9bd-3fe2-4273-a0d6-730234de3bfa tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:13:54 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-6525d9bd-3fe2-4273-a0d6-730234de3bfa tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:13:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6525d9bd-3fe2-4273-a0d6-730234de3bfa tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6525d9bd-3fe2-4273-a0d6-730234de3bfa tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6525d9bd-3fe2-4273-a0d6-730234de3bfa tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6525d9bd-3fe2-4273-a0d6-730234de3bfa tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:13:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6525d9bd-3fe2-4273-a0d6-730234de3bfa tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:13:54 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6525d9bd-3fe2-4273-a0d6-730234de3bfa tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:13:54 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-6525d9bd-3fe2-4273-a0d6-730234de3bfa tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:13:54 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-6525d9bd-3fe2-4273-a0d6-730234de3bfa tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 200 len: 1427 microversion: 2.1 time: 0.150567 Apr 13 19:13:54 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 232/698] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:13:54 2023] GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 1427 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-5246c5e3-b401-48a7-afbf-988e6e6938a2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-5246c5e3-b401-48a7-afbf-988e6e6938a2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5246c5e3-b401-48a7-afbf-988e6e6938a2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5246c5e3-b401-48a7-afbf-988e6e6938a2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5246c5e3-b401-48a7-afbf-988e6e6938a2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5246c5e3-b401-48a7-afbf-988e6e6938a2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5246c5e3-b401-48a7-afbf-988e6e6938a2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-5246c5e3-b401-48a7-afbf-988e6e6938a2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:10 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-5246c5e3-b401-48a7-afbf-988e6e6938a2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.099198 Apr 13 19:14:10 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 232/699] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 19:14:10 2023] GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-interface => generated 282 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:10 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-325d39cf-ca90-4a30-8033-efe3b4015506 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:14:10 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-325d39cf-ca90-4a30-8033-efe3b4015506 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:10 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:14:10 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=12 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:14:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-325d39cf-ca90-4a30-8033-efe3b4015506 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-325d39cf-ca90-4a30-8033-efe3b4015506 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-325d39cf-ca90-4a30-8033-efe3b4015506 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-325d39cf-ca90-4a30-8033-efe3b4015506 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-325d39cf-ca90-4a30-8033-efe3b4015506 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-325d39cf-ca90-4a30-8033-efe3b4015506 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:10 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-325d39cf-ca90-4a30-8033-efe3b4015506 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80063ed703d24a1b84aede724db205a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2877676ccbd0484d80ecabf3030c0ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:14:10 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-325d39cf-ca90-4a30-8033-efe3b4015506 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9428f3f-1910-421d-be9c-7ca42fa46334" status: 200 len: 1486 microversion: 2.1 time: 0.193115 Apr 13 19:14:10 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 236/700] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:14:10 2023] GET /compute/v2.1/servers/e9428f3f-1910-421d-be9c-7ca42fa46334 => generated 1486 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:14:10 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:10 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:14:10 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=8 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:14:10 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:10 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:10 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:10 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] Creating event network-changed:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:14:10 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036149 Apr 13 19:14:10 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 233/701] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:14:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecf4fd59-73f4-48eb-881a-97c8fbb14959"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:11 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "POST /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297198 Apr 13 19:14:11 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 233/702] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:14:10 2023] POST /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:11 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-61313656-8869-45c7-90db-260470210db1 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:14:11 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-61313656-8869-45c7-90db-260470210db1 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-61313656-8869-45c7-90db-260470210db1 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-61313656-8869-45c7-90db-260470210db1 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-61313656-8869-45c7-90db-260470210db1 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-61313656-8869-45c7-90db-260470210db1 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-61313656-8869-45c7-90db-260470210db1 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-61313656-8869-45c7-90db-260470210db1 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:12 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-61313656-8869-45c7-90db-260470210db1 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9282b733244da9bf210ddc66b74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1ef6e7b159468f90cfc0db2e8e904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:14:12 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-61313656-8869-45c7-90db-260470210db1 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d" status: 200 len: 1701 microversion: 2.1 time: 0.209444 Apr 13 19:14:12 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 237/703] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:14:11 2023] GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d => generated 1701 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:14:18 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:18 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:18 user devstack@n-api.service[61588]: DEBUG nova.objects.instance [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'flavor' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=61588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:14:19 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "POST /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/action" status: 200 len: 32 microversion: 2.1 time: 0.161498 Apr 13 19:14:19 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 234/704] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:14:18 2023] POST /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:14:19 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-0503a2f2-9b25-418d-a066-d3065e27e0b0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:14:19 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-0503a2f2-9b25-418d-a066-d3065e27e0b0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0503a2f2-9b25-418d-a066-d3065e27e0b0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0503a2f2-9b25-418d-a066-d3065e27e0b0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0503a2f2-9b25-418d-a066-d3065e27e0b0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0503a2f2-9b25-418d-a066-d3065e27e0b0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0503a2f2-9b25-418d-a066-d3065e27e0b0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0503a2f2-9b25-418d-a066-d3065e27e0b0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:19 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-0503a2f2-9b25-418d-a066-d3065e27e0b0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:14:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-0503a2f2-9b25-418d-a066-d3065e27e0b0 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab" status: 200 len: 1724 microversion: 2.1 time: 0.156605 Apr 13 19:14:19 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 234/705] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:14:19 2023] GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:14:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-4956c2b3-ad4e-46bd-99a1-6268e886e788 req-990c464a-09dc-46b7-b087-a7570c831488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-unplugged", "status": "completed", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4956c2b3-ad4e-46bd-99a1-6268e886e788 req-990c464a-09dc-46b7-b087-a7570c831488 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4956c2b3-ad4e-46bd-99a1-6268e886e788 req-990c464a-09dc-46b7-b087-a7570c831488 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4956c2b3-ad4e-46bd-99a1-6268e886e788 req-990c464a-09dc-46b7-b087-a7570c831488 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-4956c2b3-ad4e-46bd-99a1-6268e886e788 req-990c464a-09dc-46b7-b087-a7570c831488 service nova] Creating event network-vif-unplugged:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:14:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-4956c2b3-ad4e-46bd-99a1-6268e886e788 req-990c464a-09dc-46b7-b087-a7570c831488 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030050 Apr 13 19:14:19 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 238/706] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:14:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:21 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-df92b2e0-e89a-4d9d-9263-344bce1c69c7 req-a08c018c-327d-41b5-bd76-3e01693c6acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-plugged", "status": "completed", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-df92b2e0-e89a-4d9d-9263-344bce1c69c7 req-a08c018c-327d-41b5-bd76-3e01693c6acd service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-df92b2e0-e89a-4d9d-9263-344bce1c69c7 req-a08c018c-327d-41b5-bd76-3e01693c6acd service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-df92b2e0-e89a-4d9d-9263-344bce1c69c7 req-a08c018c-327d-41b5-bd76-3e01693c6acd service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:21 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-df92b2e0-e89a-4d9d-9263-344bce1c69c7 req-a08c018c-327d-41b5-bd76-3e01693c6acd service nova] Creating event network-vif-plugged:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:14:21 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-df92b2e0-e89a-4d9d-9263-344bce1c69c7 req-a08c018c-327d-41b5-bd76-3e01693c6acd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033354 Apr 13 19:14:21 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 235/707] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:14:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:23 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-plugged", "status": "completed", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}, {"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-plugged", "status": "completed", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:23 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] Creating event network-vif-plugged:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:14:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] Creating event network-vif-plugged:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:14:23 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037927 Apr 13 19:14:23 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 235/708] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:14:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:43 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:14:43 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=14 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:14:43 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1d19527a-1823-4e52-bcc1-016c740ea7e9 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:14:43 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-1d19527a-1823-4e52-bcc1-016c740ea7e9 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1d19527a-1823-4e52-bcc1-016c740ea7e9 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1d19527a-1823-4e52-bcc1-016c740ea7e9 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1d19527a-1823-4e52-bcc1-016c740ea7e9 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1d19527a-1823-4e52-bcc1-016c740ea7e9 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1d19527a-1823-4e52-bcc1-016c740ea7e9 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:43 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1d19527a-1823-4e52-bcc1-016c740ea7e9 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:43 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-1d19527a-1823-4e52-bcc1-016c740ea7e9 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dea69daeb2475f84b5a46821288be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b7cc9c0ba145bea0585e887a92c788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:14:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-1d19527a-1823-4e52-bcc1-016c740ea7e9 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac" status: 200 len: 1565 microversion: 2.1 time: 0.211126 Apr 13 19:14:43 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 239/709] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:14:43 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac => generated 1565 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:14:46 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080204b2-fd4d-4224-b391-a27036d058ac", "tag": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:46 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:14:46 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:14:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:46 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] Creating event network-changed:a29956b4-c9c2-4c86-bf4a-488fb5f45af0 for instance 080204b2-fd4d-4224-b391-a27036d058ac on user Apr 13 19:14:46 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035690 Apr 13 19:14:46 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 236/710] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:14:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54fb8bde-5953-4aa4-ad80-0e14e1690582"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:46 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:46 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=8 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:14:46 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:14:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "POST /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365536 Apr 13 19:14:47 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 236/711] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:14:46 2023] POST /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:51 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-b7e5e9c1-d3af-42d6-918f-072c0ddca681 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:14:51 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-b7e5e9c1-d3af-42d6-918f-072c0ddca681 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b7e5e9c1-d3af-42d6-918f-072c0ddca681 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b7e5e9c1-d3af-42d6-918f-072c0ddca681 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b7e5e9c1-d3af-42d6-918f-072c0ddca681 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b7e5e9c1-d3af-42d6-918f-072c0ddca681 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b7e5e9c1-d3af-42d6-918f-072c0ddca681 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b7e5e9c1-d3af-42d6-918f-072c0ddca681 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:51 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-b7e5e9c1-d3af-42d6-918f-072c0ddca681 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.105615 Apr 13 19:14:51 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 240/712] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 19:14:51 2023] GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8/os-interface => generated 283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d7439c2-317e-4454-905f-dc8e59bc49e8", "tag": "2df65aa5-af8b-4d51-8246-ed31a3e0219e"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:52 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] Creating event network-changed:2df65aa5-af8b-4d51-8246-ed31a3e0219e for instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 on user Apr 13 19:14:52 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028167 Apr 13 19:14:52 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 237/713] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:14:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-fcee8fc0-b5bf-4b98-82d8-8759b9c55472 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-fcee8fc0-b5bf-4b98-82d8-8759b9c55472 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fcee8fc0-b5bf-4b98-82d8-8759b9c55472 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fcee8fc0-b5bf-4b98-82d8-8759b9c55472 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fcee8fc0-b5bf-4b98-82d8-8759b9c55472 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fcee8fc0-b5bf-4b98-82d8-8759b9c55472 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fcee8fc0-b5bf-4b98-82d8-8759b9c55472 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-fcee8fc0-b5bf-4b98-82d8-8759b9c55472 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:52 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-fcee8fc0-b5bf-4b98-82d8-8759b9c55472 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8/ips" status: 200 len: 109 microversion: 2.1 time: 0.039625 Apr 13 19:14:52 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 237/714] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 19:14:52 2023] GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8/ips => generated 109 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:52 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c46cad2d-aacd-409b-9b85-9006a8809680 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc03d2f5-5d25-4ada-bde0-5c2d270b60f7"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:52 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-c46cad2d-aacd-409b-9b85-9006a8809680 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c46cad2d-aacd-409b-9b85-9006a8809680 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c46cad2d-aacd-409b-9b85-9006a8809680 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c46cad2d-aacd-409b-9b85-9006a8809680 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c46cad2d-aacd-409b-9b85-9006a8809680 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c46cad2d-aacd-409b-9b85-9006a8809680 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c46cad2d-aacd-409b-9b85-9006a8809680 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:52 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-c46cad2d-aacd-409b-9b85-9006a8809680 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Invalid volume: volume cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 is already attached to instances: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d Apr 13 19:14:52 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c46cad2d-aacd-409b-9b85-9006a8809680 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:14:52 user devstack@n-api.service[61587]: request: POST /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8/os-volume_attachments HTTP/1.1 Apr 13 19:14:52 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:14:52 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:14:52 user devstack@n-api.service[61587]: Connection: close Apr 13 19:14:52 user devstack@n-api.service[61587]: Content-Length: 74 Apr 13 19:14:52 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:14:52 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:14:52 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:14:52 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:14:52 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:14:52 user devstack@n-api.service[61587]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:14:52 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:14:52 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:14:52 user devstack@n-api.service[61587]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:14:52 user devstack@n-api.service[61587]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:14:52 user devstack@n-api.service[61587]: Apr 13 19:14:52 user devstack@n-api.service[61587]: {"volumeAttachment": {"volumeId": "cc03d2f5-5d25-4ada-bde0-5c2d270b60f7"}} Apr 13 19:14:52 user devstack@n-api.service[61587]: method: > Apr 13 19:14:52 user devstack@n-api.service[61587]: exception: Invalid volume: volume cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 is already attached to instances: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d Apr 13 19:14:52 user devstack@n-api.service[61587]: action_args: {'server_id': '1d7439c2-317e-4454-905f-dc8e59bc49e8', 'body': {'volumeAttachment': {'volumeId': 'cc03d2f5-5d25-4ada-bde0-5c2d270b60f7'}}} Apr 13 19:14:52 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 is already attached to instances: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 is already attached to instances: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 is already attached to instances: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d Apr 13 19:14:52 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:14:52 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c46cad2d-aacd-409b-9b85-9006a8809680 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 400 to user: Invalid volume: volume cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 is already attached to instances: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:14:52 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-c46cad2d-aacd-409b-9b85-9006a8809680 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094235 Apr 13 19:14:52 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 241/715] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:14:52 2023] POST /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:52 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:14:52 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8" status: 204 len: 0 microversion: 2.1 time: 0.109589 Apr 13 19:14:52 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 238/716] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:14:52 2023] DELETE /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-bcccd5e2-4c3a-475e-ad29-b93866302614 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-bcccd5e2-4c3a-475e-ad29-b93866302614 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bcccd5e2-4c3a-475e-ad29-b93866302614 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bcccd5e2-4c3a-475e-ad29-b93866302614 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bcccd5e2-4c3a-475e-ad29-b93866302614 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bcccd5e2-4c3a-475e-ad29-b93866302614 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bcccd5e2-4c3a-475e-ad29-b93866302614 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bcccd5e2-4c3a-475e-ad29-b93866302614 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:53 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-bcccd5e2-4c3a-475e-ad29-b93866302614 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:14:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-bcccd5e2-4c3a-475e-ad29-b93866302614 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8" status: 200 len: 1551 microversion: 2.1 time: 0.162002 Apr 13 19:14:53 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 238/717] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:14:52 2023] GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8 => generated 1551 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:14:54 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d7439c2-317e-4454-905f-dc8e59bc49e8", "name": "network-vif-unplugged", "status": "completed", "tag": "2df65aa5-af8b-4d51-8246-ed31a3e0219e"}, {"server_uuid": "1d7439c2-317e-4454-905f-dc8e59bc49e8", "name": "network-vif-plugged", "status": "completed", "tag": "2df65aa5-af8b-4d51-8246-ed31a3e0219e"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:54 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] Creating event network-vif-unplugged:2df65aa5-af8b-4d51-8246-ed31a3e0219e for instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 on user Apr 13 19:14:54 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] Creating event network-vif-plugged:2df65aa5-af8b-4d51-8246-ed31a3e0219e for instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 on user Apr 13 19:14:54 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031529 Apr 13 19:14:54 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 242/718] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:14:54 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:55 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-1206b21d-bc3d-4de8-94d9-6d4151985057 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:14:55 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-1206b21d-bc3d-4de8-94d9-6d4151985057 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1206b21d-bc3d-4de8-94d9-6d4151985057 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1206b21d-bc3d-4de8-94d9-6d4151985057 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1206b21d-bc3d-4de8-94d9-6d4151985057 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1206b21d-bc3d-4de8-94d9-6d4151985057 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1206b21d-bc3d-4de8-94d9-6d4151985057 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:55 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1206b21d-bc3d-4de8-94d9-6d4151985057 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:55 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-1206b21d-bc3d-4de8-94d9-6d4151985057 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.099571 Apr 13 19:14:55 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 239/719] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 19:14:55 2023] GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694/os-interface => generated 282 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:55 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7f192a13-df74-46c6-9ae7-dca83a9eca42 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:14:55 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-7f192a13-df74-46c6-9ae7-dca83a9eca42 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7f192a13-df74-46c6-9ae7-dca83a9eca42 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7f192a13-df74-46c6-9ae7-dca83a9eca42 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7f192a13-df74-46c6-9ae7-dca83a9eca42 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7f192a13-df74-46c6-9ae7-dca83a9eca42 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7f192a13-df74-46c6-9ae7-dca83a9eca42 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7f192a13-df74-46c6-9ae7-dca83a9eca42 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:56 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-7f192a13-df74-46c6-9ae7-dca83a9eca42 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:14:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7f192a13-df74-46c6-9ae7-dca83a9eca42 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 200 len: 1427 microversion: 2.1 time: 0.178770 Apr 13 19:14:56 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 239/720] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:14:55 2023] GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Old instance type m1.nano, new instance type m1.micro {{(pid=61587) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for project c162f91cba4b4ecf9de48fbf839da261. Resources: {'cores', 'ram'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting quotas for user df209814208d415e9d414d39205aaad6 and project c162f91cba4b4ecf9de48fbf839da261. Resources: {'cores', 'ram'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:14:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:14:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694/action" status: 202 len: 0 microversion: 2.1 time: 0.165344 Apr 13 19:14:56 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 243/721] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:14:56 2023] POST /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:14:56 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-facf57fb-1e61-4b92-b415-4008e0ee4c75 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:14:56 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-facf57fb-1e61-4b92-b415-4008e0ee4c75 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:14:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-facf57fb-1e61-4b92-b415-4008e0ee4c75 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-facf57fb-1e61-4b92-b415-4008e0ee4c75 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-facf57fb-1e61-4b92-b415-4008e0ee4c75 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-facf57fb-1e61-4b92-b415-4008e0ee4c75 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-facf57fb-1e61-4b92-b415-4008e0ee4c75 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-facf57fb-1e61-4b92-b415-4008e0ee4c75 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:56 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-facf57fb-1e61-4b92-b415-4008e0ee4c75 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:14:56 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-facf57fb-1e61-4b92-b415-4008e0ee4c75 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 200 len: 1436 microversion: 2.1 time: 0.156166 Apr 13 19:14:56 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 240/722] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:14:56 2023] GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 1436 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:14:56 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d7439c2-317e-4454-905f-dc8e59bc49e8", "name": "network-vif-deleted", "tag": "2df65aa5-af8b-4d51-8246-ed31a3e0219e"}, {"name": "network-changed", "server_uuid": "579c83e7-7976-47f4-9f25-a194e39966ba", "tag": "ab959649-556a-479c-9e13-ec36fb9ebb66"}, {"name": "network-changed", "server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Creating event network-vif-deleted:2df65aa5-af8b-4d51-8246-ed31a3e0219e for instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 on user Apr 13 19:14:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Creating event network-changed:ab959649-556a-479c-9e13-ec36fb9ebb66 for instance 579c83e7-7976-47f4-9f25-a194e39966ba on user Apr 13 19:14:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Creating event network-changed:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:14:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.046409 Apr 13 19:14:56 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 240/723] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:14:56 2023] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:14:58 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-unplugged", "status": "completed", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:14:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:14:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:14:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:14:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] Creating event network-vif-unplugged:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:14:59 user devstack@n-api.service[61587]: DEBUG nova.compute.api [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] Instance a9f3d080-a163-4897-9187-2687cae49694 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 19:14:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041122 Apr 13 19:14:59 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 244/724] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:14:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:15:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-plugged", "status": "completed", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:15:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:01 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] Creating event network-vif-plugged:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:15:01 user devstack@n-api.service[61588]: DEBUG nova.compute.api [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] Instance a9f3d080-a163-4897-9187-2687cae49694 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 19:15:01 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040906 Apr 13 19:15:01 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 241/725] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:15:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:15:03 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:03 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:03 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'services' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:15:03 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments/54fb8bde-5953-4aa4-ad80-0e14e1690582" status: 202 len: 0 microversion: 2.1 time: 0.178456 Apr 13 19:15:03 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 241/726] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:15:03 2023] DELETE /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments/54fb8bde-5953-4aa4-ad80-0e14e1690582 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:15:03 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e1cd436a-bcce-474d-b4c3-ecbc4aca2504 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:03 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e1cd436a-bcce-474d-b4c3-ecbc4aca2504 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e1cd436a-bcce-474d-b4c3-ecbc4aca2504 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e1cd436a-bcce-474d-b4c3-ecbc4aca2504 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e1cd436a-bcce-474d-b4c3-ecbc4aca2504 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e1cd436a-bcce-474d-b4c3-ecbc4aca2504 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e1cd436a-bcce-474d-b4c3-ecbc4aca2504 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e1cd436a-bcce-474d-b4c3-ecbc4aca2504 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e1cd436a-bcce-474d-b4c3-ecbc4aca2504 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082334 Apr 13 19:15:03 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 245/727] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:15:03 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:15:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-plugged", "status": "completed", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:15:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] Creating event network-vif-plugged:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:15:09 user devstack@n-api.service[61588]: DEBUG nova.compute.api [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] Instance a9f3d080-a163-4897-9187-2687cae49694 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 19:15:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042547 Apr 13 19:15:09 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 242/728] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:15:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:15:09 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ea73c6b2-bbfd-4d18-ada2-c7345bf9895a tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:09 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ea73c6b2-bbfd-4d18-ada2-c7345bf9895a tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ea73c6b2-bbfd-4d18-ada2-c7345bf9895a tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ea73c6b2-bbfd-4d18-ada2-c7345bf9895a tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ea73c6b2-bbfd-4d18-ada2-c7345bf9895a tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ea73c6b2-bbfd-4d18-ada2-c7345bf9895a tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ea73c6b2-bbfd-4d18-ada2-c7345bf9895a tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ea73c6b2-bbfd-4d18-ada2-c7345bf9895a tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:09 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-ea73c6b2-bbfd-4d18-ada2-c7345bf9895a tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:15:09 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ea73c6b2-bbfd-4d18-ada2-c7345bf9895a tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab" status: 200 len: 1704 microversion: 2.1 time: 0.288122 Apr 13 19:15:09 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 242/729] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:15:09 2023] GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab => generated 1704 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:15:10 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:10 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:10 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:10 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:15:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e9428f3f-1910-421d-be9c-7ca42fa46334" status: 204 len: 0 microversion: 2.1 time: 0.191835 Apr 13 19:15:11 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 246/730] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:15:10 2023] DELETE /compute/v2.1/servers/e9428f3f-1910-421d-be9c-7ca42fa46334 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:15:11 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a10f6534-e24e-4f17-92fe-0804f6583c58 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:11 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-a10f6534-e24e-4f17-92fe-0804f6583c58 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a10f6534-e24e-4f17-92fe-0804f6583c58 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a10f6534-e24e-4f17-92fe-0804f6583c58 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a10f6534-e24e-4f17-92fe-0804f6583c58 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a10f6534-e24e-4f17-92fe-0804f6583c58 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a10f6534-e24e-4f17-92fe-0804f6583c58 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a10f6534-e24e-4f17-92fe-0804f6583c58 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:11 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-plugged", "status": "completed", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:15:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:11 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:11 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] Creating event network-vif-plugged:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:15:11 user devstack@n-api.service[61589]: DEBUG nova.compute.api [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] Instance a9f3d080-a163-4897-9187-2687cae49694 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61589) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 19:15:11 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042419 Apr 13 19:15:11 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 243/731] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:15:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:15:11 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-a10f6534-e24e-4f17-92fe-0804f6583c58 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80063ed703d24a1b84aede724db205a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2877676ccbd0484d80ecabf3030c0ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:15:11 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-236de2dd-8f30-4f82-af62-a511fb166ca4 req-86b4d55e-5e2a-4638-a1ed-070ba92353bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9428f3f-1910-421d-be9c-7ca42fa46334", "name": "network-vif-unplugged", "status": "completed", "tag": "06aa9cb5-cf77-482a-8292-b82631f08459"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:15:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-a10f6534-e24e-4f17-92fe-0804f6583c58 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9428f3f-1910-421d-be9c-7ca42fa46334" status: 200 len: 1492 microversion: 2.1 time: 0.197560 Apr 13 19:15:11 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 243/732] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:15:11 2023] GET /compute/v2.1/servers/e9428f3f-1910-421d-be9c-7ca42fa46334 => generated 1492 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:15:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-236de2dd-8f30-4f82-af62-a511fb166ca4 req-86b4d55e-5e2a-4638-a1ed-070ba92353bd service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-236de2dd-8f30-4f82-af62-a511fb166ca4 req-86b4d55e-5e2a-4638-a1ed-070ba92353bd service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-236de2dd-8f30-4f82-af62-a511fb166ca4 req-86b4d55e-5e2a-4638-a1ed-070ba92353bd service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-236de2dd-8f30-4f82-af62-a511fb166ca4 req-86b4d55e-5e2a-4638-a1ed-070ba92353bd service nova] Creating event network-vif-unplugged:06aa9cb5-cf77-482a-8292-b82631f08459 for instance e9428f3f-1910-421d-be9c-7ca42fa46334 on user Apr 13 19:15:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-236de2dd-8f30-4f82-af62-a511fb166ca4 req-86b4d55e-5e2a-4638-a1ed-070ba92353bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038866 Apr 13 19:15:11 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 247/733] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:15:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:15:12 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:15:12 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "POST /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/action" status: 202 len: 0 microversion: 2.1 time: 0.219663 Apr 13 19:15:12 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 244/734] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:15:12 2023] POST /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:15:12 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0c06c427-9712-4833-a69d-9555132d5aac tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:12 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-0c06c427-9712-4833-a69d-9555132d5aac tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0c06c427-9712-4833-a69d-9555132d5aac tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0c06c427-9712-4833-a69d-9555132d5aac tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0c06c427-9712-4833-a69d-9555132d5aac tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0c06c427-9712-4833-a69d-9555132d5aac tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0c06c427-9712-4833-a69d-9555132d5aac tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0c06c427-9712-4833-a69d-9555132d5aac tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:12 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-0c06c427-9712-4833-a69d-9555132d5aac tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.098086 Apr 13 19:15:12 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 244/735] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 19:15:12 2023] GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/os-interface => generated 282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:15:13 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9428f3f-1910-421d-be9c-7ca42fa46334", "name": "network-vif-plugged", "status": "completed", "tag": "06aa9cb5-cf77-482a-8292-b82631f08459"}, {"server_uuid": "e9428f3f-1910-421d-be9c-7ca42fa46334", "name": "network-vif-deleted", "tag": "06aa9cb5-cf77-482a-8292-b82631f08459"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:15:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:13 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] Creating event network-vif-plugged:06aa9cb5-cf77-482a-8292-b82631f08459 for instance e9428f3f-1910-421d-be9c-7ca42fa46334 on user Apr 13 19:15:13 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] Creating event network-vif-deleted:06aa9cb5-cf77-482a-8292-b82631f08459 for instance e9428f3f-1910-421d-be9c-7ca42fa46334 on user Apr 13 19:15:13 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036580 Apr 13 19:15:13 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 248/736] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:15:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:15:13 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-27646b87-6cd3-42fd-ae2a-3715260e84f4 req-8dee0a0f-2b10-409c-8eb3-c2674ac0b448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-unplugged", "status": "completed", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:15:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-27646b87-6cd3-42fd-ae2a-3715260e84f4 req-8dee0a0f-2b10-409c-8eb3-c2674ac0b448 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-27646b87-6cd3-42fd-ae2a-3715260e84f4 req-8dee0a0f-2b10-409c-8eb3-c2674ac0b448 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-27646b87-6cd3-42fd-ae2a-3715260e84f4 req-8dee0a0f-2b10-409c-8eb3-c2674ac0b448 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:13 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-27646b87-6cd3-42fd-ae2a-3715260e84f4 req-8dee0a0f-2b10-409c-8eb3-c2674ac0b448 service nova] Creating event network-vif-unplugged:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:15:13 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-27646b87-6cd3-42fd-ae2a-3715260e84f4 req-8dee0a0f-2b10-409c-8eb3-c2674ac0b448 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038667 Apr 13 19:15:13 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 245/737] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:15:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:15:15 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-plugged", "status": "completed", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}, {"name": "network-changed", "server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}, {"name": "network-changed", "server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}, {"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-plugged", "status": "completed", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}, {"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-plugged", "status": "completed", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:15:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:15 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Creating event network-vif-plugged:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:15:15 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Creating event network-changed:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:15:15 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Creating event network-changed:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:15:15 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Creating event network-vif-plugged:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:15:15 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Creating event network-vif-plugged:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:15:15 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 859 microversion: 2.1 time: 0.031498 Apr 13 19:15:15 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 245/738] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:15:15 2023] POST /compute/v2.1/os-server-external-events => generated 859 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:15:29 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:29 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:29 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:29 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:29 user devstack@n-api.service[61587]: DEBUG nova.objects.instance [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'services' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=61587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:15:29 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/os-volume_attachments/ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185" status: 202 len: 0 microversion: 2.1 time: 0.173390 Apr 13 19:15:29 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 249/739] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:15:29 2023] DELETE /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/os-volume_attachments/ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:15:29 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e1a2f3cd-23eb-4eea-b1fe-75761506a736 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:29 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e1a2f3cd-23eb-4eea-b1fe-75761506a736 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:29 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=20 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:29 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e1a2f3cd-23eb-4eea-b1fe-75761506a736 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e1a2f3cd-23eb-4eea-b1fe-75761506a736 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e1a2f3cd-23eb-4eea-b1fe-75761506a736 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e1a2f3cd-23eb-4eea-b1fe-75761506a736 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e1a2f3cd-23eb-4eea-b1fe-75761506a736 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e1a2f3cd-23eb-4eea-b1fe-75761506a736 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:29 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e1a2f3cd-23eb-4eea-b1fe-75761506a736 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050177 Apr 13 19:15:29 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 246/740] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:15:29 2023] GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:15:43 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:43 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:43 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-eb6fb740-e394-4a00-9202-1f0580476b52 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:43 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-eb6fb740-e394-4a00-9202-1f0580476b52 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eb6fb740-e394-4a00-9202-1f0580476b52 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eb6fb740-e394-4a00-9202-1f0580476b52 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eb6fb740-e394-4a00-9202-1f0580476b52 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eb6fb740-e394-4a00-9202-1f0580476b52 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eb6fb740-e394-4a00-9202-1f0580476b52 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-eb6fb740-e394-4a00-9202-1f0580476b52 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-eb6fb740-e394-4a00-9202-1f0580476b52 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:15:43 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-eb6fb740-e394-4a00-9202-1f0580476b52 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:15:43 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8 HTTP/1.1 Apr 13 19:15:43 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:15:43 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:15:43 user devstack@n-api.service[61588]: Connection: close Apr 13 19:15:43 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:15:43 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:15:43 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:15:43 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:15:43 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:15:43 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:15:43 user devstack@n-api.service[61588]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:15:43 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:15:43 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:15:43 user devstack@n-api.service[61588]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:15:43 user devstack@n-api.service[61588]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:15:43 user devstack@n-api.service[61588]: method: > Apr 13 19:15:43 user devstack@n-api.service[61588]: exception: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:15:43 user devstack@n-api.service[61588]: action_args: {'id': '1d7439c2-317e-4454-905f-dc8e59bc49e8'} Apr 13 19:15:43 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:15:43 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:15:43 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-eb6fb740-e394-4a00-9202-1f0580476b52 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 404 to user: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:15:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-eb6fb740-e394-4a00-9202-1f0580476b52 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8" status: 404 len: 111 microversion: 2.1 time: 0.037432 Apr 13 19:15:43 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 246/741] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:15:43 2023] GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:15:43 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:43 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:43 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-166fa1e1-c164-4f7f-bd9a-3955b8e071cf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '.version_select at 0x7efe33c8b5b0>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-166fa1e1-c164-4f7f-bd9a-3955b8e071cf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-701851917" status: 202 len: 0 microversion: 2.1 time: 0.031951 Apr 13 19:15:43 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 250/742] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 19:15:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-701851917 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:15:44 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:44 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:44 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:44 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:44 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'services' on Instance uuid ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:15:44 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/os-volume_attachments/cc03d2f5-5d25-4ada-bde0-5c2d270b60f7" status: 202 len: 0 microversion: 2.1 time: 0.169519 Apr 13 19:15:44 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 247/743] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:15:44 2023] DELETE /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/os-volume_attachments/cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:15:44 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-985f0593-e676-40f4-81b2-78103b1b6be6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:44 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-985f0593-e676-40f4-81b2-78103b1b6be6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-985f0593-e676-40f4-81b2-78103b1b6be6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-985f0593-e676-40f4-81b2-78103b1b6be6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-985f0593-e676-40f4-81b2-78103b1b6be6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-985f0593-e676-40f4-81b2-78103b1b6be6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-985f0593-e676-40f4-81b2-78103b1b6be6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-985f0593-e676-40f4-81b2-78103b1b6be6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-985f0593-e676-40f4-81b2-78103b1b6be6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042679 Apr 13 19:15:44 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 247/744] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:15:44 2023] GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:15:46 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-41472c8c-c282-4dbe-833b-eb30976679e7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:46 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-41472c8c-c282-4dbe-833b-eb30976679e7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-41472c8c-c282-4dbe-833b-eb30976679e7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-41472c8c-c282-4dbe-833b-eb30976679e7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-41472c8c-c282-4dbe-833b-eb30976679e7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-41472c8c-c282-4dbe-833b-eb30976679e7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-41472c8c-c282-4dbe-833b-eb30976679e7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-41472c8c-c282-4dbe-833b-eb30976679e7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:46 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-41472c8c-c282-4dbe-833b-eb30976679e7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:15:46 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-41472c8c-c282-4dbe-833b-eb30976679e7 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 200 len: 1552 microversion: 2.1 time: 0.208526 Apr 13 19:15:46 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 251/745] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:15:46 2023] GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 1552 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:15:53 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e7687047-786c-4855-8b6e-2aeb61b9d5ce tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:15:53 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e7687047-786c-4855-8b6e-2aeb61b9d5ce tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e7687047-786c-4855-8b6e-2aeb61b9d5ce tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e7687047-786c-4855-8b6e-2aeb61b9d5ce tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e7687047-786c-4855-8b6e-2aeb61b9d5ce tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e7687047-786c-4855-8b6e-2aeb61b9d5ce tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e7687047-786c-4855-8b6e-2aeb61b9d5ce tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e7687047-786c-4855-8b6e-2aeb61b9d5ce tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e7687047-786c-4855-8b6e-2aeb61b9d5ce tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044697 Apr 13 19:15:53 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 248/746] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:15:53 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:15:56 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "391615e7-83e5-4e38-bf6d-80450b7b687b"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:15:56 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:15:56 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:56 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=8 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:15:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:15:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:15:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:15:56 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "POST /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279872 Apr 13 19:15:56 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 248/747] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:15:56 2023] POST /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:16:01 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:16:01 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:16:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a479fff0-43dc-4b91-9122-c95740b354f4 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:01 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-a479fff0-43dc-4b91-9122-c95740b354f4 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a479fff0-43dc-4b91-9122-c95740b354f4 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a479fff0-43dc-4b91-9122-c95740b354f4 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a479fff0-43dc-4b91-9122-c95740b354f4 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a479fff0-43dc-4b91-9122-c95740b354f4 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a479fff0-43dc-4b91-9122-c95740b354f4 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a479fff0-43dc-4b91-9122-c95740b354f4 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-a479fff0-43dc-4b91-9122-c95740b354f4 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] HTTP exception thrown: Instance e9428f3f-1910-421d-be9c-7ca42fa46334 could not be found. Apr 13 19:16:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a479fff0-43dc-4b91-9122-c95740b354f4 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Request method failure captured: Apr 13 19:16:01 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/e9428f3f-1910-421d-be9c-7ca42fa46334 HTTP/1.1 Apr 13 19:16:01 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:16:01 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:16:01 user devstack@n-api.service[61587]: Connection: close Apr 13 19:16:01 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:16:01 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:16:01 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:16:01 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:16:01 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFOrtpkdTwN-eRNohkLT0R_6qbVcy5YK4REy5WI66HMemUHPPYK_UjZwykxIqEOuiXC_tP-Ve8odYZ71PMqjc-cBmD9TLLkV7krUqOECFxtj2qSDRTcR1x9gqH1Wp3u97vYjR-AxIbidsSzvqQDbNZwYJjKOSS46TXWAayGYGBJ0Wz4 Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Project-Id: 2877676ccbd0484d80ecabf3030c0ee4 Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Project-Name: tempest-VolumesActionsTest-427747232 Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2877676ccbd0484d80ecabf3030c0ee4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2877676ccbd0484d80ecabf3030c0ee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2877676ccbd0484d80ecabf3030c0ee4"}]}] Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Tenant: tempest-VolumesActionsTest-427747232 Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Tenant-Id: 2877676ccbd0484d80ecabf3030c0ee4 Apr 13 19:16:01 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-VolumesActionsTest-427747232 Apr 13 19:16:01 user devstack@n-api.service[61587]: X-User: tempest-VolumesActionsTest-427747232-project-member Apr 13 19:16:01 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:16:01 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:16:01 user devstack@n-api.service[61587]: X-User-Id: 80063ed703d24a1b84aede724db205a7 Apr 13 19:16:01 user devstack@n-api.service[61587]: X-User-Name: tempest-VolumesActionsTest-427747232-project-member Apr 13 19:16:01 user devstack@n-api.service[61587]: method: > Apr 13 19:16:01 user devstack@n-api.service[61587]: exception: Instance e9428f3f-1910-421d-be9c-7ca42fa46334 could not be found. Apr 13 19:16:01 user devstack@n-api.service[61587]: action_args: {'id': 'e9428f3f-1910-421d-be9c-7ca42fa46334'} Apr 13 19:16:01 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9428f3f-1910-421d-be9c-7ca42fa46334 could not be found. Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9428f3f-1910-421d-be9c-7ca42fa46334 could not be found. Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9428f3f-1910-421d-be9c-7ca42fa46334 could not be found. Apr 13 19:16:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:16:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a479fff0-43dc-4b91-9122-c95740b354f4 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Returning 404 to user: Instance e9428f3f-1910-421d-be9c-7ca42fa46334 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:16:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a479fff0-43dc-4b91-9122-c95740b354f4 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9428f3f-1910-421d-be9c-7ca42fa46334" status: 404 len: 111 microversion: 2.1 time: 0.137047 Apr 13 19:16:01 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 252/748] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:16:01 2023] GET /compute/v2.1/servers/e9428f3f-1910-421d-be9c-7ca42fa46334 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:16:03 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:03 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:03 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'services' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:16:03 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments/391615e7-83e5-4e38-bf6d-80450b7b687b" status: 202 len: 0 microversion: 2.1 time: 0.189543 Apr 13 19:16:03 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 249/749] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:16:03 2023] DELETE /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments/391615e7-83e5-4e38-bf6d-80450b7b687b => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:16:03 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-80f3b07a-f4ff-4732-948f-7614eacacbcb tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:03 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-80f3b07a-f4ff-4732-948f-7614eacacbcb tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-80f3b07a-f4ff-4732-948f-7614eacacbcb tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-80f3b07a-f4ff-4732-948f-7614eacacbcb tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-80f3b07a-f4ff-4732-948f-7614eacacbcb tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-80f3b07a-f4ff-4732-948f-7614eacacbcb tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-80f3b07a-f4ff-4732-948f-7614eacacbcb tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-80f3b07a-f4ff-4732-948f-7614eacacbcb tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:03 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-80f3b07a-f4ff-4732-948f-7614eacacbcb tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047958 Apr 13 19:16:03 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 249/750] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:16:03 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:16:09 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-fbe7a294-3e91-42c9-8768-f0f2565b4a62 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:09 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-fbe7a294-3e91-42c9-8768-f0f2565b4a62 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-fbe7a294-3e91-42c9-8768-f0f2565b4a62 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-fbe7a294-3e91-42c9-8768-f0f2565b4a62 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-fbe7a294-3e91-42c9-8768-f0f2565b4a62 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-fbe7a294-3e91-42c9-8768-f0f2565b4a62 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-fbe7a294-3e91-42c9-8768-f0f2565b4a62 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:09 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-fbe7a294-3e91-42c9-8768-f0f2565b4a62 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:09 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-fbe7a294-3e91-42c9-8768-f0f2565b4a62 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 01bd39f7-7d27-48cf-982e-181aadc060ab while it is in vm_state rescued Apr 13 19:16:09 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-fbe7a294-3e91-42c9-8768-f0f2565b4a62 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Request method failure captured: Apr 13 19:16:09 user devstack@n-api.service[61587]: request: DELETE /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-volume_attachments/ecf4fd59-73f4-48eb-881a-97c8fbb14959 HTTP/1.1 Apr 13 19:16:09 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:16:09 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:16:09 user devstack@n-api.service[61587]: Connection: close Apr 13 19:16:09 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:16:09 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:16:09 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:16:09 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:16:09 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFIW5I_A2oi7_fnWAXup5bR_1v4_NxI2GY1J1uY5nA0Rpx18iBmtG3f0vrXqcApPhKfHUi1pI15fOYoO4JzcqVLkugFjbCLEnhTIfLFsB4wc3App5vw0u0L75IqNFxG2VAhF9UVebRhkjPsHR1_2ogh-T-bEdLq7RR3AuJbhokeecMs Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Project-Id: 42fbd7089a7e4ba8b2597fca0d8e84c8 Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}] Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Tenant-Id: 42fbd7089a7e4ba8b2597fca0d8e84c8 Apr 13 19:16:09 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:16:09 user devstack@n-api.service[61587]: X-User: tempest-ServerRescueNegativeTestJSON-1255770111-project-member Apr 13 19:16:09 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:16:09 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:16:09 user devstack@n-api.service[61587]: X-User-Id: 3bebf61a7401492692f9c60adde178f7 Apr 13 19:16:09 user devstack@n-api.service[61587]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255770111-project-member Apr 13 19:16:09 user devstack@n-api.service[61587]: method: > Apr 13 19:16:09 user devstack@n-api.service[61587]: exception: Cannot 'detach_volume' instance 01bd39f7-7d27-48cf-982e-181aadc060ab while it is in vm_state rescued Apr 13 19:16:09 user devstack@n-api.service[61587]: action_args: {'server_id': '01bd39f7-7d27-48cf-982e-181aadc060ab', 'id': 'ecf4fd59-73f4-48eb-881a-97c8fbb14959'} Apr 13 19:16:09 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01bd39f7-7d27-48cf-982e-181aadc060ab in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 01bd39f7-7d27-48cf-982e-181aadc060ab while it is in vm_state rescued Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 01bd39f7-7d27-48cf-982e-181aadc060ab while it is in vm_state rescued Apr 13 19:16:09 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:16:09 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-fbe7a294-3e91-42c9-8768-f0f2565b4a62 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Returning 409 to user: Cannot 'detach_volume' instance 01bd39f7-7d27-48cf-982e-181aadc060ab while it is in vm_state rescued {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:16:09 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-fbe7a294-3e91-42c9-8768-f0f2565b4a62 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-volume_attachments/ecf4fd59-73f4-48eb-881a-97c8fbb14959" status: 409 len: 152 microversion: 2.1 time: 0.130094 Apr 13 19:16:09 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 253/751] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:16:09 2023] DELETE /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-volume_attachments/ecf4fd59-73f4-48eb-881a-97c8fbb14959 => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 13 19:16:09 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:09 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:09 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "POST /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/action" status: 202 len: 0 microversion: 2.1 time: 0.081462 Apr 13 19:16:09 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 250/752] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:16:09 2023] POST /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 19:16:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-dae4696b-3bd1-4ccb-875f-bc6405c180a3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:09 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-dae4696b-3bd1-4ccb-875f-bc6405c180a3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dae4696b-3bd1-4ccb-875f-bc6405c180a3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dae4696b-3bd1-4ccb-875f-bc6405c180a3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dae4696b-3bd1-4ccb-875f-bc6405c180a3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dae4696b-3bd1-4ccb-875f-bc6405c180a3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dae4696b-3bd1-4ccb-875f-bc6405c180a3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-dae4696b-3bd1-4ccb-875f-bc6405c180a3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:10 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-dae4696b-3bd1-4ccb-875f-bc6405c180a3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:16:10 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-dae4696b-3bd1-4ccb-875f-bc6405c180a3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab" status: 200 len: 1712 microversion: 2.1 time: 0.165853 Apr 13 19:16:10 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 250/753] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:16:09 2023] GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab => generated 1712 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:16:10 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-32f831dc-bd53-4b73-ab59-1e0fb28cab34 req-f690350a-872f-4123-8f28-c3557ed37ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-unplugged", "status": "completed", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-32f831dc-bd53-4b73-ab59-1e0fb28cab34 req-f690350a-872f-4123-8f28-c3557ed37ed3 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-32f831dc-bd53-4b73-ab59-1e0fb28cab34 req-f690350a-872f-4123-8f28-c3557ed37ed3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-32f831dc-bd53-4b73-ab59-1e0fb28cab34 req-f690350a-872f-4123-8f28-c3557ed37ed3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:10 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-32f831dc-bd53-4b73-ab59-1e0fb28cab34 req-f690350a-872f-4123-8f28-c3557ed37ed3 service nova] Creating event network-vif-unplugged:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:16:10 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-32f831dc-bd53-4b73-ab59-1e0fb28cab34 req-f690350a-872f-4123-8f28-c3557ed37ed3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036531 Apr 13 19:16:10 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 254/754] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:16:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:16:12 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-6de72cea-3a01-4356-9441-0bc40720b3d7 req-ff0dc9fe-8ccf-4e52-a410-d0ab15ea5fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-plugged", "status": "completed", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6de72cea-3a01-4356-9441-0bc40720b3d7 req-ff0dc9fe-8ccf-4e52-a410-d0ab15ea5fe9 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6de72cea-3a01-4356-9441-0bc40720b3d7 req-ff0dc9fe-8ccf-4e52-a410-d0ab15ea5fe9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-6de72cea-3a01-4356-9441-0bc40720b3d7 req-ff0dc9fe-8ccf-4e52-a410-d0ab15ea5fe9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-6de72cea-3a01-4356-9441-0bc40720b3d7 req-ff0dc9fe-8ccf-4e52-a410-d0ab15ea5fe9 service nova] Creating event network-vif-plugged:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:16:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-6de72cea-3a01-4356-9441-0bc40720b3d7 req-ff0dc9fe-8ccf-4e52-a410-d0ab15ea5fe9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038890 Apr 13 19:16:12 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 251/755] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:16:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:16:14 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-plugged", "status": "completed", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}, {"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-plugged", "status": "completed", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:14 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:14 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:14 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] Creating event network-vif-plugged:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:16:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] Creating event network-vif-plugged:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:16:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039602 Apr 13 19:16:14 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 251/756] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:16:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:16:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-07878552-f470-4607-ae59-e6be3d691de8 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:19 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-07878552-f470-4607-ae59-e6be3d691de8 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07878552-f470-4607-ae59-e6be3d691de8 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07878552-f470-4607-ae59-e6be3d691de8 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07878552-f470-4607-ae59-e6be3d691de8 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07878552-f470-4607-ae59-e6be3d691de8 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07878552-f470-4607-ae59-e6be3d691de8 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07878552-f470-4607-ae59-e6be3d691de8 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-07878552-f470-4607-ae59-e6be3d691de8 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055195 Apr 13 19:16:19 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 255/757] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:16:19 2023] GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:16:23 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=10 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:16:23 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:16:23 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-031e8ff7-bd9a-43e7-8472-02aaad468ce8 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '.version_select at 0x7efe33db0700>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-031e8ff7-bd9a-43e7-8472-02aaad468ce8 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/36e14854-8ca1-420d-8642-21ad4d51b5d6" status: 204 len: 0 microversion: 2.1 time: 1.143378 Apr 13 19:16:24 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 252/758] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:16:23 2023] DELETE /compute/v2.1/images/36e14854-8ca1-420d-8642-21ad4d51b5d6 => generated 0 bytes in 1145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:16:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=8 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:16:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:16:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:24 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:25 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:16:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d" status: 204 len: 0 microversion: 2.1 time: 0.142285 Apr 13 19:16:25 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 252/759] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:16:24 2023] DELETE /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:16:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-157e1214-0772-4342-b9a7-099744e3c30a tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:25 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-157e1214-0772-4342-b9a7-099744e3c30a tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-157e1214-0772-4342-b9a7-099744e3c30a tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-157e1214-0772-4342-b9a7-099744e3c30a tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-157e1214-0772-4342-b9a7-099744e3c30a tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-157e1214-0772-4342-b9a7-099744e3c30a tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-157e1214-0772-4342-b9a7-099744e3c30a tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-157e1214-0772-4342-b9a7-099744e3c30a tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:25 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-157e1214-0772-4342-b9a7-099744e3c30a tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a9282b733244da9bf210ddc66b74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1ef6e7b159468f90cfc0db2e8e904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:16:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-157e1214-0772-4342-b9a7-099744e3c30a tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d" status: 200 len: 1675 microversion: 2.1 time: 0.206916 Apr 13 19:16:25 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 256/760] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:16:25 2023] GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:16:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-de669163-4031-46d3-8ad7-c328b2fd69a3 req-2e4e0800-27cd-4830-90fc-a32eae8cc433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-unplugged", "status": "completed", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-de669163-4031-46d3-8ad7-c328b2fd69a3 req-2e4e0800-27cd-4830-90fc-a32eae8cc433 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-de669163-4031-46d3-8ad7-c328b2fd69a3 req-2e4e0800-27cd-4830-90fc-a32eae8cc433 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-de669163-4031-46d3-8ad7-c328b2fd69a3 req-2e4e0800-27cd-4830-90fc-a32eae8cc433 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-de669163-4031-46d3-8ad7-c328b2fd69a3 req-2e4e0800-27cd-4830-90fc-a32eae8cc433 service nova] Creating event network-vif-unplugged:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:16:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-de669163-4031-46d3-8ad7-c328b2fd69a3 req-2e4e0800-27cd-4830-90fc-a32eae8cc433 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033603 Apr 13 19:16:25 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 253/761] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:16:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:16:26 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-bc2c0632-06d3-4f01-ac55-e8efce51170b req-725b8744-0cea-4fca-951d-80fd16cdf6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-deleted", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-bc2c0632-06d3-4f01-ac55-e8efce51170b req-725b8744-0cea-4fca-951d-80fd16cdf6a8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-bc2c0632-06d3-4f01-ac55-e8efce51170b req-725b8744-0cea-4fca-951d-80fd16cdf6a8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:26 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-bc2c0632-06d3-4f01-ac55-e8efce51170b req-725b8744-0cea-4fca-951d-80fd16cdf6a8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:26 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-bc2c0632-06d3-4f01-ac55-e8efce51170b req-725b8744-0cea-4fca-951d-80fd16cdf6a8 service nova] Creating event network-vif-deleted:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:16:26 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-bc2c0632-06d3-4f01-ac55-e8efce51170b req-725b8744-0cea-4fca-951d-80fd16cdf6a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045835 Apr 13 19:16:26 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 253/762] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:16:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:16:27 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-aaeaa6be-17ed-4706-b73c-f1af9092489e req-bf454a7d-4473-4d19-96be-946e37dc5f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33367b19-4d62-46dc-8346-45ea09c5563d", "name": "network-vif-plugged", "status": "completed", "tag": "6d1659d8-90f3-45a5-90a0-772abe02c673"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-aaeaa6be-17ed-4706-b73c-f1af9092489e req-bf454a7d-4473-4d19-96be-946e37dc5f09 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-aaeaa6be-17ed-4706-b73c-f1af9092489e req-bf454a7d-4473-4d19-96be-946e37dc5f09 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-aaeaa6be-17ed-4706-b73c-f1af9092489e req-bf454a7d-4473-4d19-96be-946e37dc5f09 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:27 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-aaeaa6be-17ed-4706-b73c-f1af9092489e req-bf454a7d-4473-4d19-96be-946e37dc5f09 service nova] Creating event network-vif-plugged:6d1659d8-90f3-45a5-90a0-772abe02c673 for instance 33367b19-4d62-46dc-8346-45ea09c5563d on user Apr 13 19:16:27 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-aaeaa6be-17ed-4706-b73c-f1af9092489e req-bf454a7d-4473-4d19-96be-946e37dc5f09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030474 Apr 13 19:16:27 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 257/763] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:16:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:16:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-db09eaa4-1d27-4eaf-b4b4-a4282e63b7bf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:34 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-db09eaa4-1d27-4eaf-b4b4-a4282e63b7bf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-db09eaa4-1d27-4eaf-b4b4-a4282e63b7bf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-db09eaa4-1d27-4eaf-b4b4-a4282e63b7bf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-db09eaa4-1d27-4eaf-b4b4-a4282e63b7bf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-db09eaa4-1d27-4eaf-b4b4-a4282e63b7bf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-db09eaa4-1d27-4eaf-b4b4-a4282e63b7bf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-db09eaa4-1d27-4eaf-b4b4-a4282e63b7bf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-db09eaa4-1d27-4eaf-b4b4-a4282e63b7bf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.157888 Apr 13 19:16:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 254/764] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:16:34 2023] GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:16:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:34 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:34 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:16:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" status: 204 len: 0 microversion: 2.1 time: 0.183898 Apr 13 19:16:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 254/765] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:16:34 2023] DELETE /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:16:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-db8dea42-1e9e-4401-96d4-c3dec3043d59 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:34 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-db8dea42-1e9e-4401-96d4-c3dec3043d59 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:34 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=13 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:16:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-db8dea42-1e9e-4401-96d4-c3dec3043d59 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-db8dea42-1e9e-4401-96d4-c3dec3043d59 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-db8dea42-1e9e-4401-96d4-c3dec3043d59 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-db8dea42-1e9e-4401-96d4-c3dec3043d59 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-db8dea42-1e9e-4401-96d4-c3dec3043d59 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-db8dea42-1e9e-4401-96d4-c3dec3043d59 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:34 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=25 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:16:34 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-db8dea42-1e9e-4401-96d4-c3dec3043d59 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:16:34 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-db8dea42-1e9e-4401-96d4-c3dec3043d59 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" status: 200 len: 1670 microversion: 2.1 time: 0.174946 Apr 13 19:16:34 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 258/766] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:16:34 2023] GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:16:35 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-4067502f-5c46-4547-b15d-73c2bddfe7ae req-9da43719-6938-41a1-a686-804b8281d27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d", "name": "network-vif-unplugged", "status": "completed", "tag": "e124e179-0315-423a-b9cf-c232753845ed"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-4067502f-5c46-4547-b15d-73c2bddfe7ae req-9da43719-6938-41a1-a686-804b8281d27a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-4067502f-5c46-4547-b15d-73c2bddfe7ae req-9da43719-6938-41a1-a686-804b8281d27a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:35 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-4067502f-5c46-4547-b15d-73c2bddfe7ae req-9da43719-6938-41a1-a686-804b8281d27a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:35 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-4067502f-5c46-4547-b15d-73c2bddfe7ae req-9da43719-6938-41a1-a686-804b8281d27a service nova] Creating event network-vif-unplugged:e124e179-0315-423a-b9cf-c232753845ed for instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d on user Apr 13 19:16:35 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-4067502f-5c46-4547-b15d-73c2bddfe7ae req-9da43719-6938-41a1-a686-804b8281d27a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027586 Apr 13 19:16:35 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 255/767] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:16:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:16:37 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d", "name": "network-vif-plugged", "status": "completed", "tag": "e124e179-0315-423a-b9cf-c232753845ed"}, {"server_uuid": "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d", "name": "network-vif-deleted", "tag": "e124e179-0315-423a-b9cf-c232753845ed"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] Creating event network-vif-plugged:e124e179-0315-423a-b9cf-c232753845ed for instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d on user Apr 13 19:16:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] Creating event network-vif-deleted:e124e179-0315-423a-b9cf-c232753845ed for instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d on user Apr 13 19:16:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038386 Apr 13 19:16:37 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 255/768] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:16:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:16:41 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-430407348", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:41 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] validate_networks() for [('0e855c73-cf7d-4c09-9fb5-3a4a7903b519', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Getting quotas for project 024f13d8c179482791ed1545b6b2efd8. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Getting quotas for user 789fdd98ede74e6783b667178c2689fb and project 024f13d8c179482791ed1545b6b2efd8. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:16:42 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:16:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.605605 Apr 13 19:16:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 259/769] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:16:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:16:42 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-51a56b00-2636-4abc-a4e8-be98404da71e tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:42 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-51a56b00-2636-4abc-a4e8-be98404da71e tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:42 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-51a56b00-2636-4abc-a4e8-be98404da71e tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789fdd98ede74e6783b667178c2689fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024f13d8c179482791ed1545b6b2efd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:16:42 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-51a56b00-2636-4abc-a4e8-be98404da71e tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a" status: 200 len: 1212 microversion: 2.1 time: 0.176289 Apr 13 19:16:42 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 256/770] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:16:42 2023] GET /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a => generated 1212 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:16:44 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166341f7-a5fa-4034-8281-6aed0be1bd5a", "tag": "3e4a73da-8c31-4a03-a16a-69ff3f84b550"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:45 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] Creating event network-changed:3e4a73da-8c31-4a03-a16a-69ff3f84b550 for instance 166341f7-a5fa-4034-8281-6aed0be1bd5a on user Apr 13 19:16:45 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035622 Apr 13 19:16:45 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 256/771] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:16:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:16:46 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:46 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:46 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694/action" status: 204 len: 0 microversion: 2.1 time: 0.089282 Apr 13 19:16:46 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 260/772] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:16:46 2023] POST /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:16:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-53b97559-945e-407c-959f-dbf2ceeabb74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:46 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-53b97559-945e-407c-959f-dbf2ceeabb74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:46 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=10 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:16:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-53b97559-945e-407c-959f-dbf2ceeabb74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-53b97559-945e-407c-959f-dbf2ceeabb74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-53b97559-945e-407c-959f-dbf2ceeabb74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-53b97559-945e-407c-959f-dbf2ceeabb74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-53b97559-945e-407c-959f-dbf2ceeabb74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-53b97559-945e-407c-959f-dbf2ceeabb74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:47 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-53b97559-945e-407c-959f-dbf2ceeabb74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:16:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-53b97559-945e-407c-959f-dbf2ceeabb74 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 200 len: 1552 microversion: 2.1 time: 0.166004 Apr 13 19:16:47 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 257/773] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:16:46 2023] GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:16:47 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-ba333d86-f48b-4cf7-a812-3488771ca614 req-adb876ae-fa19-4073-8fb7-17f50d1db271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166341f7-a5fa-4034-8281-6aed0be1bd5a", "name": "network-vif-plugged", "status": "completed", "tag": "3e4a73da-8c31-4a03-a16a-69ff3f84b550"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ba333d86-f48b-4cf7-a812-3488771ca614 req-adb876ae-fa19-4073-8fb7-17f50d1db271 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ba333d86-f48b-4cf7-a812-3488771ca614 req-adb876ae-fa19-4073-8fb7-17f50d1db271 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ba333d86-f48b-4cf7-a812-3488771ca614 req-adb876ae-fa19-4073-8fb7-17f50d1db271 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-ba333d86-f48b-4cf7-a812-3488771ca614 req-adb876ae-fa19-4073-8fb7-17f50d1db271 service nova] Creating event network-vif-plugged:3e4a73da-8c31-4a03-a16a-69ff3f84b550 for instance 166341f7-a5fa-4034-8281-6aed0be1bd5a on user Apr 13 19:16:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-ba333d86-f48b-4cf7-a812-3488771ca614 req-adb876ae-fa19-4073-8fb7-17f50d1db271 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050945 Apr 13 19:16:47 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 257/774] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:16:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:16:49 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-87a99ab3-ee53-43ec-a8f4-3bc06db5faa0 req-e6d49d01-c32b-4917-aad8-ef7d898a1b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166341f7-a5fa-4034-8281-6aed0be1bd5a", "name": "network-vif-plugged", "status": "completed", "tag": "3e4a73da-8c31-4a03-a16a-69ff3f84b550"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-87a99ab3-ee53-43ec-a8f4-3bc06db5faa0 req-e6d49d01-c32b-4917-aad8-ef7d898a1b8b service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-87a99ab3-ee53-43ec-a8f4-3bc06db5faa0 req-e6d49d01-c32b-4917-aad8-ef7d898a1b8b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-87a99ab3-ee53-43ec-a8f4-3bc06db5faa0 req-e6d49d01-c32b-4917-aad8-ef7d898a1b8b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:49 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-87a99ab3-ee53-43ec-a8f4-3bc06db5faa0 req-e6d49d01-c32b-4917-aad8-ef7d898a1b8b service nova] Creating event network-vif-plugged:3e4a73da-8c31-4a03-a16a-69ff3f84b550 for instance 166341f7-a5fa-4034-8281-6aed0be1bd5a on user Apr 13 19:16:49 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-87a99ab3-ee53-43ec-a8f4-3bc06db5faa0 req-e6d49d01-c32b-4917-aad8-ef7d898a1b8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031971 Apr 13 19:16:49 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 261/775] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:16:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:16:53 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-6cbfb775-7afd-4adc-a5de-ecb2ee482243 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:16:53 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-6cbfb775-7afd-4adc-a5de-ecb2ee482243 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:53 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:16:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6cbfb775-7afd-4adc-a5de-ecb2ee482243 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6cbfb775-7afd-4adc-a5de-ecb2ee482243 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6cbfb775-7afd-4adc-a5de-ecb2ee482243 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6cbfb775-7afd-4adc-a5de-ecb2ee482243 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6cbfb775-7afd-4adc-a5de-ecb2ee482243 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6cbfb775-7afd-4adc-a5de-ecb2ee482243 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-6cbfb775-7afd-4adc-a5de-ecb2ee482243 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047891 Apr 13 19:16:53 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 258/776] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:16:53 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:16:56 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73f562c0-29d2-40b3-ab57-aec970aee446"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:16:56 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:16:56 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:16:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:16:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:16:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:16:56 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:16:56 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "POST /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340455 Apr 13 19:16:56 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 258/777] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:16:56 2023] POST /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-9d59c2dc-897d-4c26-96e2-6f2d9c88ce85 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-9d59c2dc-897d-4c26-96e2-6f2d9c88ce85 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9d59c2dc-897d-4c26-96e2-6f2d9c88ce85 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9d59c2dc-897d-4c26-96e2-6f2d9c88ce85 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9d59c2dc-897d-4c26-96e2-6f2d9c88ce85 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9d59c2dc-897d-4c26-96e2-6f2d9c88ce85 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9d59c2dc-897d-4c26-96e2-6f2d9c88ce85 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9d59c2dc-897d-4c26-96e2-6f2d9c88ce85 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:00 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-9d59c2dc-897d-4c26-96e2-6f2d9c88ce85 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:17:00 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-9d59c2dc-897d-4c26-96e2-6f2d9c88ce85 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab" status: 200 len: 1718 microversion: 2.1 time: 0.260401 Apr 13 19:17:00 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 262/778] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:17:00 2023] GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab => generated 1718 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:17:04 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:17:04 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:17:04 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=14 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:04 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=12 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:04 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'services' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:17:04 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments/73f562c0-29d2-40b3-ab57-aec970aee446" status: 202 len: 0 microversion: 2.1 time: 0.172760 Apr 13 19:17:04 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 259/779] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:17:04 2023] DELETE /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments/73f562c0-29d2-40b3-ab57-aec970aee446 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:17:04 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-9ae94a6d-2a23-4606-bccd-52690a5be503 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:17:04 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-9ae94a6d-2a23-4606-bccd-52690a5be503 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:17:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9ae94a6d-2a23-4606-bccd-52690a5be503 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9ae94a6d-2a23-4606-bccd-52690a5be503 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9ae94a6d-2a23-4606-bccd-52690a5be503 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9ae94a6d-2a23-4606-bccd-52690a5be503 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9ae94a6d-2a23-4606-bccd-52690a5be503 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9ae94a6d-2a23-4606-bccd-52690a5be503 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:04 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-9ae94a6d-2a23-4606-bccd-52690a5be503 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052190 Apr 13 19:17:04 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 259/780] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:17:04 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:17:15 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-da66bc29-be4a-4394-ae90-896d85a50eae tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:17:15 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-da66bc29-be4a-4394-ae90-896d85a50eae tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:17:15 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:15 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-da66bc29-be4a-4394-ae90-896d85a50eae tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-da66bc29-be4a-4394-ae90-896d85a50eae tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-da66bc29-be4a-4394-ae90-896d85a50eae tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-da66bc29-be4a-4394-ae90-896d85a50eae tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-da66bc29-be4a-4394-ae90-896d85a50eae tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-da66bc29-be4a-4394-ae90-896d85a50eae tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-da66bc29-be4a-4394-ae90-896d85a50eae tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] HTTP exception thrown: Instance 33367b19-4d62-46dc-8346-45ea09c5563d could not be found. Apr 13 19:17:15 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-da66bc29-be4a-4394-ae90-896d85a50eae tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Request method failure captured: Apr 13 19:17:15 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d HTTP/1.1 Apr 13 19:17:15 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:17:15 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:17:15 user devstack@n-api.service[61587]: Connection: close Apr 13 19:17:15 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:17:15 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:17:15 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:17:15 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:17:15 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFNlDRtmlY14J9H6O6SNQJt3bQ4IXMZM5QY73i0L0L-dENG3BDIsfF4s8V8Z8v37jYM__ROgA4Okf1hIECqnvrh0cPuqgzJCw-lsHvm0KCEzHDIzzf58WRPpsGnl8NpodW09LrkWSgjtNLqbSaIwYJddzGvTysaM61sp6LWOTK6G6SE Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Project-Id: 7e1ef6e7b159468f90cfc0db2e8e904d Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Project-Name: tempest-ServerStableDeviceRescueTest-192327838 Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7e1ef6e7b159468f90cfc0db2e8e904d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7e1ef6e7b159468f90cfc0db2e8e904d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7e1ef6e7b159468f90cfc0db2e8e904d"}]}] Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Tenant: tempest-ServerStableDeviceRescueTest-192327838 Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Tenant-Id: 7e1ef6e7b159468f90cfc0db2e8e904d Apr 13 19:17:15 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-192327838 Apr 13 19:17:15 user devstack@n-api.service[61587]: X-User: tempest-ServerStableDeviceRescueTest-192327838-project-member Apr 13 19:17:15 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:17:15 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:17:15 user devstack@n-api.service[61587]: X-User-Id: 4a9282b733244da9bf210ddc66b74816 Apr 13 19:17:15 user devstack@n-api.service[61587]: X-User-Name: tempest-ServerStableDeviceRescueTest-192327838-project-member Apr 13 19:17:15 user devstack@n-api.service[61587]: method: > Apr 13 19:17:15 user devstack@n-api.service[61587]: exception: Instance 33367b19-4d62-46dc-8346-45ea09c5563d could not be found. Apr 13 19:17:15 user devstack@n-api.service[61587]: action_args: {'id': '33367b19-4d62-46dc-8346-45ea09c5563d'} Apr 13 19:17:15 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33367b19-4d62-46dc-8346-45ea09c5563d could not be found. Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33367b19-4d62-46dc-8346-45ea09c5563d could not be found. Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33367b19-4d62-46dc-8346-45ea09c5563d could not be found. Apr 13 19:17:15 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:17:15 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-da66bc29-be4a-4394-ae90-896d85a50eae tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Returning 404 to user: Instance 33367b19-4d62-46dc-8346-45ea09c5563d could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:17:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-da66bc29-be4a-4394-ae90-896d85a50eae tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d" status: 404 len: 111 microversion: 2.1 time: 0.035700 Apr 13 19:17:15 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 263/781] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:17:15 2023] GET /compute/v2.1/servers/33367b19-4d62-46dc-8346-45ea09c5563d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:17:15 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:15 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:15 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-17787de6-b2d7-40db-a842-2fb84e830d06 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Calling method '.version_select at 0x7efe33d5c700>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:17:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-17787de6-b2d7-40db-a842-2fb84e830d06 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-822105464" status: 202 len: 0 microversion: 2.1 time: 0.031290 Apr 13 19:17:15 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 260/782] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 19:17:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-822105464 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 19:17:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c1dfa779-5c08-49f5-969d-dc1600519775 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:17:24 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-c1dfa779-5c08-49f5-969d-dc1600519775 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:17:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=3 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c1dfa779-5c08-49f5-969d-dc1600519775 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c1dfa779-5c08-49f5-969d-dc1600519775 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c1dfa779-5c08-49f5-969d-dc1600519775 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c1dfa779-5c08-49f5-969d-dc1600519775 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c1dfa779-5c08-49f5-969d-dc1600519775 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c1dfa779-5c08-49f5-969d-dc1600519775 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-c1dfa779-5c08-49f5-969d-dc1600519775 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:17:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c1dfa779-5c08-49f5-969d-dc1600519775 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:17:24 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d HTTP/1.1 Apr 13 19:17:24 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:17:24 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:17:24 user devstack@n-api.service[61588]: Connection: close Apr 13 19:17:24 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:17:24 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:17:24 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:17:24 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:17:24 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:17:24 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:17:24 user devstack@n-api.service[61588]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:17:24 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:17:24 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:17:24 user devstack@n-api.service[61588]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:17:24 user devstack@n-api.service[61588]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:17:24 user devstack@n-api.service[61588]: method: > Apr 13 19:17:24 user devstack@n-api.service[61588]: exception: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:17:24 user devstack@n-api.service[61588]: action_args: {'id': 'ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d'} Apr 13 19:17:24 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:17:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:17:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:17:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:17:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:17:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:17:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:17:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c1dfa779-5c08-49f5-969d-dc1600519775 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 404 to user: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:17:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-c1dfa779-5c08-49f5-969d-dc1600519775 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" status: 404 len: 111 microversion: 2.1 time: 0.033759 Apr 13 19:17:25 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 260/783] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:17:24 2023] GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:17:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-6d9f32ac-fbc4-46ef-8ac9-633e614248bf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '.version_select at 0x7efe33c89ea0>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:17:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-6d9f32ac-fbc4-46ef-8ac9-633e614248bf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1344017995" status: 202 len: 0 microversion: 2.1 time: 0.161499 Apr 13 19:17:25 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 264/784] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 19:17:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1344017995 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:17:25 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e9054609-9da2-4088-9d90-2bef5797b04a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: .version_select at 0x7efe33d5fb50>, body: {"keypair": {"name": "tempest-keypair-737326002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqWTeW94mC6Qab592n4roQSgR0ReQD5GgNdKv6uLCTG70d8Ti2XZh02FAhLCrLlr4yJF7KPa+B4KdHaRg688OqQ3OKYgcRxDDHxlwTkNdr/Fm6F9nxu0scVEuiXFVXE8w=="}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:17:25 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-e9054609-9da2-4088-9d90-2bef5797b04a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:17:25 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-e9054609-9da2-4088-9d90-2bef5797b04a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for user 975d5fe9f1e445f0ba1be8fc71e93ecc and project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:17:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e9054609-9da2-4088-9d90-2bef5797b04a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050390 Apr 13 19:17:25 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 261/785] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:17:25 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:17:27 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-451260104", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c6740647-dbe4-4a73-ada4-b154eca2af81"}], "security_groups": [{"name": "tempest-securitygroup--1782981629"}], "key_name": "tempest-keypair-737326002", "user_data": "}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:17:27 user devstack@n-api.service[61588]: DEBUG nova.network.neutron [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] validate_networks() for [('c6740647-dbe4-4a73-ada4-b154eca2af81', None, None, None, None, None)] {{(pid=61588) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for user 975d5fe9f1e445f0ba1be8fc71e93ecc and project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Going to run 1 instances... {{(pid=61588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:17:28 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:17:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.858198 Apr 13 19:17:28 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 261/786] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:17:27 2023] POST /compute/v2.1/servers => generated 400 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:17:28 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0f58194e-bc38-43c7-a112-1f01d380d9e6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:17:28 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-0f58194e-bc38-43c7-a112-1f01d380d9e6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:17:28 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-0f58194e-bc38-43c7-a112-1f01d380d9e6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:17:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-0f58194e-bc38-43c7-a112-1f01d380d9e6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79" status: 200 len: 1234 microversion: 2.1 time: 0.089783 Apr 13 19:17:28 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 265/787] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:17:28 2023] GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79 => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:17:31 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "620bc9c9-26a0-461f-8771-418b3e9aea79", "tag": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:17:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:31 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] Creating event network-changed:96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance 620bc9c9-26a0-461f-8771-418b3e9aea79 on user Apr 13 19:17:31 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138659 Apr 13 19:17:31 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 262/788] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:17:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:17:32 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-af39bfdb-fad7-49e5-8ec9-138f3d87c5e3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:17:32 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-af39bfdb-fad7-49e5-8ec9-138f3d87c5e3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:17:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-af39bfdb-fad7-49e5-8ec9-138f3d87c5e3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-af39bfdb-fad7-49e5-8ec9-138f3d87c5e3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-af39bfdb-fad7-49e5-8ec9-138f3d87c5e3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-af39bfdb-fad7-49e5-8ec9-138f3d87c5e3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-af39bfdb-fad7-49e5-8ec9-138f3d87c5e3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-af39bfdb-fad7-49e5-8ec9-138f3d87c5e3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:32 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-af39bfdb-fad7-49e5-8ec9-138f3d87c5e3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789fdd98ede74e6783b667178c2689fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024f13d8c179482791ed1545b6b2efd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:17:32 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-af39bfdb-fad7-49e5-8ec9-138f3d87c5e3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a" status: 200 len: 1494 microversion: 2.1 time: 0.168437 Apr 13 19:17:32 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 262/789] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:17:32 2023] GET /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a => generated 1494 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:17:33 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-f64e7dc5-507b-41c6-85b8-5274e6de9071 req-151753ea-beb6-44c8-81dc-fec6234b22f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620bc9c9-26a0-461f-8771-418b3e9aea79", "name": "network-vif-plugged", "status": "completed", "tag": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:17:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-f64e7dc5-507b-41c6-85b8-5274e6de9071 req-151753ea-beb6-44c8-81dc-fec6234b22f8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-f64e7dc5-507b-41c6-85b8-5274e6de9071 req-151753ea-beb6-44c8-81dc-fec6234b22f8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-f64e7dc5-507b-41c6-85b8-5274e6de9071 req-151753ea-beb6-44c8-81dc-fec6234b22f8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-f64e7dc5-507b-41c6-85b8-5274e6de9071 req-151753ea-beb6-44c8-81dc-fec6234b22f8 service nova] Creating event network-vif-plugged:96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance 620bc9c9-26a0-461f-8771-418b3e9aea79 on user Apr 13 19:17:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-f64e7dc5-507b-41c6-85b8-5274e6de9071 req-151753ea-beb6-44c8-81dc-fec6234b22f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038727 Apr 13 19:17:33 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 266/790] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:17:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:17:36 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:36 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-cd5151b4-76c4-4402-a045-36645cb38d15 req-f491b20b-a83e-409c-b1f7-f5a30106a742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620bc9c9-26a0-461f-8771-418b3e9aea79", "name": "network-vif-plugged", "status": "completed", "tag": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:17:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cd5151b4-76c4-4402-a045-36645cb38d15 req-f491b20b-a83e-409c-b1f7-f5a30106a742 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cd5151b4-76c4-4402-a045-36645cb38d15 req-f491b20b-a83e-409c-b1f7-f5a30106a742 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cd5151b4-76c4-4402-a045-36645cb38d15 req-f491b20b-a83e-409c-b1f7-f5a30106a742 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:36 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-cd5151b4-76c4-4402-a045-36645cb38d15 req-f491b20b-a83e-409c-b1f7-f5a30106a742 service nova] Creating event network-vif-plugged:96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance 620bc9c9-26a0-461f-8771-418b3e9aea79 on user Apr 13 19:17:36 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-cd5151b4-76c4-4402-a045-36645cb38d15 req-f491b20b-a83e-409c-b1f7-f5a30106a742 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029837 Apr 13 19:17:36 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 263/791] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:17:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:17:37 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f8db1033-6935-4224-86b2-3658e88cfcd2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:17:37 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f8db1033-6935-4224-86b2-3658e88cfcd2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:17:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f8db1033-6935-4224-86b2-3658e88cfcd2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f8db1033-6935-4224-86b2-3658e88cfcd2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f8db1033-6935-4224-86b2-3658e88cfcd2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f8db1033-6935-4224-86b2-3658e88cfcd2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f8db1033-6935-4224-86b2-3658e88cfcd2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f8db1033-6935-4224-86b2-3658e88cfcd2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:37 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-f8db1033-6935-4224-86b2-3658e88cfcd2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:17:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-f8db1033-6935-4224-86b2-3658e88cfcd2 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 200 len: 1544 microversion: 2.1 time: 0.155426 Apr 13 19:17:37 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 263/792] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:17:37 2023] GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 1544 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:17:54 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:54 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:54 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:54 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-884a9b34-0901-45e9-994e-67c482724b31 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:17:54 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-884a9b34-0901-45e9-994e-67c482724b31 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:17:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-884a9b34-0901-45e9-994e-67c482724b31 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-884a9b34-0901-45e9-994e-67c482724b31 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-884a9b34-0901-45e9-994e-67c482724b31 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-884a9b34-0901-45e9-994e-67c482724b31 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-884a9b34-0901-45e9-994e-67c482724b31 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-884a9b34-0901-45e9-994e-67c482724b31 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:55 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-884a9b34-0901-45e9-994e-67c482724b31 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.198605 Apr 13 19:17:55 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 267/793] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:17:54 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments => generated 25 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:17:58 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:58 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:17:58 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2103249-cfef-4cba-a24a-59e3c4d3be1d"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:17:58 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:17:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:17:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:17:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:17:58 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "POST /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292386 Apr 13 19:17:58 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 264/794] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:17:58 2023] POST /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:18:00 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c2084926-896c-44c0-8ac1-428afcfd33f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:00 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-c2084926-896c-44c0-8ac1-428afcfd33f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:00 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:00 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:00 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:00 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=16 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c2084926-896c-44c0-8ac1-428afcfd33f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c2084926-896c-44c0-8ac1-428afcfd33f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c2084926-896c-44c0-8ac1-428afcfd33f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c2084926-896c-44c0-8ac1-428afcfd33f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c2084926-896c-44c0-8ac1-428afcfd33f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c2084926-896c-44c0-8ac1-428afcfd33f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:00 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-c2084926-896c-44c0-8ac1-428afcfd33f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.106625 Apr 13 19:18:00 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 264/795] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 19:18:00 2023] GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-interface => generated 282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:18:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:18:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] Creating event network-changed:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:18:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029659 Apr 13 19:18:01 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 268/796] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:18:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:18:01 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:01 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:02 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'services' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:18:02 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-volume_attachments/ecf4fd59-73f4-48eb-881a-97c8fbb14959" status: 202 len: 0 microversion: 2.1 time: 0.166496 Apr 13 19:18:02 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 265/797] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:18:01 2023] DELETE /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-volume_attachments/ecf4fd59-73f4-48eb-881a-97c8fbb14959 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:18:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e75e5d9d-317e-4d9c-9bae-92191e9a1241 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:02 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e75e5d9d-317e-4d9c-9bae-92191e9a1241 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e75e5d9d-317e-4d9c-9bae-92191e9a1241 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e75e5d9d-317e-4d9c-9bae-92191e9a1241 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e75e5d9d-317e-4d9c-9bae-92191e9a1241 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e75e5d9d-317e-4d9c-9bae-92191e9a1241 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e75e5d9d-317e-4d9c-9bae-92191e9a1241 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e75e5d9d-317e-4d9c-9bae-92191e9a1241 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e75e5d9d-317e-4d9c-9bae-92191e9a1241 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050379 Apr 13 19:18:02 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 265/798] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:18:02 2023] GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:18:03 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:18:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] Creating event network-changed:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:18:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030412 Apr 13 19:18:03 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 269/799] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:18:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:18:07 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:07 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:08 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'services' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:18:08 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments/b2103249-cfef-4cba-a24a-59e3c4d3be1d" status: 202 len: 0 microversion: 2.1 time: 0.182546 Apr 13 19:18:08 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 266/800] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:18:07 2023] DELETE /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments/b2103249-cfef-4cba-a24a-59e3c4d3be1d => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:18:08 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-fba4dec4-b7d3-4223-ac52-abb95fbe948e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:08 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-fba4dec4-b7d3-4223-ac52-abb95fbe948e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:08 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-fba4dec4-b7d3-4223-ac52-abb95fbe948e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:08 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-fba4dec4-b7d3-4223-ac52-abb95fbe948e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:08 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-fba4dec4-b7d3-4223-ac52-abb95fbe948e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:08 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-fba4dec4-b7d3-4223-ac52-abb95fbe948e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:08 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-fba4dec4-b7d3-4223-ac52-abb95fbe948e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:08 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-fba4dec4-b7d3-4223-ac52-abb95fbe948e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:08 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-fba4dec4-b7d3-4223-ac52-abb95fbe948e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047588 Apr 13 19:18:08 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 266/801] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:18:08 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:18:18 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:18 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=10 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:18 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-16a7175d-ff64-41a6-aced-3ec143fcd66c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:18 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-16a7175d-ff64-41a6-aced-3ec143fcd66c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-16a7175d-ff64-41a6-aced-3ec143fcd66c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-16a7175d-ff64-41a6-aced-3ec143fcd66c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-16a7175d-ff64-41a6-aced-3ec143fcd66c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-16a7175d-ff64-41a6-aced-3ec143fcd66c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-16a7175d-ff64-41a6-aced-3ec143fcd66c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-16a7175d-ff64-41a6-aced-3ec143fcd66c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:18 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-16a7175d-ff64-41a6-aced-3ec143fcd66c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:18:18 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-16a7175d-ff64-41a6-aced-3ec143fcd66c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79" status: 200 len: 1544 microversion: 2.1 time: 0.211481 Apr 13 19:18:18 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 270/802] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:18:18 2023] GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79 => generated 1544 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 19:18:32 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:32 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:32 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d88d4ba-5a52-4f06-bd94-1f00beadd50b", "device": "/dev/vdb"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:18:32 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:32 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:32 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:32 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:32 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:32 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:32 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:33 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "POST /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340461 Apr 13 19:18:33 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 267/803] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:18:32 2023] POST /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:18:37 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:37 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=16 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:37 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-cef8da66-981f-4aab-b3da-206b04e5c07e tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:37 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-cef8da66-981f-4aab-b3da-206b04e5c07e tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cef8da66-981f-4aab-b3da-206b04e5c07e tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cef8da66-981f-4aab-b3da-206b04e5c07e tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cef8da66-981f-4aab-b3da-206b04e5c07e tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cef8da66-981f-4aab-b3da-206b04e5c07e tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cef8da66-981f-4aab-b3da-206b04e5c07e tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cef8da66-981f-4aab-b3da-206b04e5c07e tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:37 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-cef8da66-981f-4aab-b3da-206b04e5c07e tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:18:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-cef8da66-981f-4aab-b3da-206b04e5c07e tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 200 len: 1544 microversion: 2.1 time: 0.415679 Apr 13 19:18:37 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 267/804] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:18:37 2023] GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 1544 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 19:18:37 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-77326980-6614-47d1-ae61-f96a78063bf1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:18:37 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-77326980-6614-47d1-ae61-f96a78063bf1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:37 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:37 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-77326980-6614-47d1-ae61-f96a78063bf1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-77326980-6614-47d1-ae61-f96a78063bf1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-77326980-6614-47d1-ae61-f96a78063bf1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-77326980-6614-47d1-ae61-f96a78063bf1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-77326980-6614-47d1-ae61-f96a78063bf1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-77326980-6614-47d1-ae61-f96a78063bf1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:38 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-77326980-6614-47d1-ae61-f96a78063bf1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694/action" status: 200 len: 28533 microversion: 2.1 time: 0.498621 Apr 13 19:18:38 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 271/805] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:18:37 2023] POST /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694/action => generated 28533 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 19:18:38 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-de82763c-8704-426f-a78a-5ef11d0c4d86 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:38 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-de82763c-8704-426f-a78a-5ef11d0c4d86 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-de82763c-8704-426f-a78a-5ef11d0c4d86 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-de82763c-8704-426f-a78a-5ef11d0c4d86 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-de82763c-8704-426f-a78a-5ef11d0c4d86 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-de82763c-8704-426f-a78a-5ef11d0c4d86 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-de82763c-8704-426f-a78a-5ef11d0c4d86 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-de82763c-8704-426f-a78a-5ef11d0c4d86 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:38 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-de82763c-8704-426f-a78a-5ef11d0c4d86 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:18:38 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-de82763c-8704-426f-a78a-5ef11d0c4d86 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba" status: 200 len: 1537 microversion: 2.1 time: 0.225116 Apr 13 19:18:38 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 268/806] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:18:38 2023] GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba => generated 1537 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ffa6e3bd-5942-4299-a554-355bb8884486 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ffa6e3bd-5942-4299-a554-355bb8884486 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ffa6e3bd-5942-4299-a554-355bb8884486 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ffa6e3bd-5942-4299-a554-355bb8884486 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ffa6e3bd-5942-4299-a554-355bb8884486 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ffa6e3bd-5942-4299-a554-355bb8884486 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ffa6e3bd-5942-4299-a554-355bb8884486 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ffa6e3bd-5942-4299-a554-355bb8884486 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:52 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-ffa6e3bd-5942-4299-a554-355bb8884486 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046125 Apr 13 19:18:52 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 268/807] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:18:52 2023] GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:18:52 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:52 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:52 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:52 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:52 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:52 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:18:52 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab" status: 204 len: 0 microversion: 2.1 time: 0.120054 Apr 13 19:18:52 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 272/808] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:18:52 2023] DELETE /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:18:52 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d69cd04f-27c3-4154-8350-06a7da7dcffd tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:52 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-d69cd04f-27c3-4154-8350-06a7da7dcffd tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:52 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:52 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:18:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d69cd04f-27c3-4154-8350-06a7da7dcffd tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d69cd04f-27c3-4154-8350-06a7da7dcffd tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d69cd04f-27c3-4154-8350-06a7da7dcffd tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d69cd04f-27c3-4154-8350-06a7da7dcffd tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d69cd04f-27c3-4154-8350-06a7da7dcffd tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d69cd04f-27c3-4154-8350-06a7da7dcffd tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:52 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-d69cd04f-27c3-4154-8350-06a7da7dcffd tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:18:52 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d69cd04f-27c3-4154-8350-06a7da7dcffd tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab" status: 200 len: 1678 microversion: 2.1 time: 0.183119 Apr 13 19:18:52 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 269/809] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:18:52 2023] GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-b00037f3-87b3-4e6a-96fc-d78b2100ba1f req-2a49d1d9-cca8-4403-b076-85ac6944dbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-unplugged", "status": "completed", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b00037f3-87b3-4e6a-96fc-d78b2100ba1f req-2a49d1d9-cca8-4403-b076-85ac6944dbca service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b00037f3-87b3-4e6a-96fc-d78b2100ba1f req-2a49d1d9-cca8-4403-b076-85ac6944dbca service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:52 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b00037f3-87b3-4e6a-96fc-d78b2100ba1f req-2a49d1d9-cca8-4403-b076-85ac6944dbca service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:52 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-b00037f3-87b3-4e6a-96fc-d78b2100ba1f req-2a49d1d9-cca8-4403-b076-85ac6944dbca service nova] Creating event network-vif-unplugged:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:18:52 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-b00037f3-87b3-4e6a-96fc-d78b2100ba1f req-2a49d1d9-cca8-4403-b076-85ac6944dbca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033142 Apr 13 19:18:52 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 269/810] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:18:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:18:54 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-7f8a8707-0c60-4750-9037-126ac06e8df1 req-8d9a2435-7051-403e-b71b-4f4f5e4961ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-deleted", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:18:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-7f8a8707-0c60-4750-9037-126ac06e8df1 req-8d9a2435-7051-403e-b71b-4f4f5e4961ca service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-7f8a8707-0c60-4750-9037-126ac06e8df1 req-8d9a2435-7051-403e-b71b-4f4f5e4961ca service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-7f8a8707-0c60-4750-9037-126ac06e8df1 req-8d9a2435-7051-403e-b71b-4f4f5e4961ca service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:54 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-7f8a8707-0c60-4750-9037-126ac06e8df1 req-8d9a2435-7051-403e-b71b-4f4f5e4961ca service nova] Creating event network-vif-deleted:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:18:54 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-7f8a8707-0c60-4750-9037-126ac06e8df1 req-8d9a2435-7051-403e-b71b-4f4f5e4961ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221964 Apr 13 19:18:54 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 273/811] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:18:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:18:54 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-f0773b66-8466-4e9c-8e4d-031d57407e6e req-0c6486fe-312f-47bd-8568-e66f40eee2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bd39f7-7d27-48cf-982e-181aadc060ab", "name": "network-vif-plugged", "status": "completed", "tag": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:18:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-f0773b66-8466-4e9c-8e4d-031d57407e6e req-0c6486fe-312f-47bd-8568-e66f40eee2b7 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-f0773b66-8466-4e9c-8e4d-031d57407e6e req-0c6486fe-312f-47bd-8568-e66f40eee2b7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-f0773b66-8466-4e9c-8e4d-031d57407e6e req-0c6486fe-312f-47bd-8568-e66f40eee2b7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:54 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-f0773b66-8466-4e9c-8e4d-031d57407e6e req-0c6486fe-312f-47bd-8568-e66f40eee2b7 service nova] Creating event network-vif-plugged:508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab on user Apr 13 19:18:54 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-f0773b66-8466-4e9c-8e4d-031d57407e6e req-0c6486fe-312f-47bd-8568-e66f40eee2b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030723 Apr 13 19:18:54 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 270/812] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:18:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-3469bac2-2da8-400a-abb7-46c9f14cdd09 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-3469bac2-2da8-400a-abb7-46c9f14cdd09 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3469bac2-2da8-400a-abb7-46c9f14cdd09 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3469bac2-2da8-400a-abb7-46c9f14cdd09 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3469bac2-2da8-400a-abb7-46c9f14cdd09 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3469bac2-2da8-400a-abb7-46c9f14cdd09 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3469bac2-2da8-400a-abb7-46c9f14cdd09 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3469bac2-2da8-400a-abb7-46c9f14cdd09 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:58 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-3469bac2-2da8-400a-abb7-46c9f14cdd09 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040671 Apr 13 19:18:58 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 270/813] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:18:58 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:18:58 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:58 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:58 user devstack@n-api.service[61587]: DEBUG nova.objects.instance [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'services' on Instance uuid 166341f7-a5fa-4034-8281-6aed0be1bd5a {{(pid=61587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:18:58 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a/os-volume_attachments/3d88d4ba-5a52-4f06-bd94-1f00beadd50b" status: 202 len: 0 microversion: 2.1 time: 0.163317 Apr 13 19:18:58 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 274/814] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:18:58 2023] DELETE /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a/os-volume_attachments/3d88d4ba-5a52-4f06-bd94-1f00beadd50b => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:18:58 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:58 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:58 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Going to try to terminate instance {{(pid=61589) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:18:58 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a" status: 204 len: 0 microversion: 2.1 time: 0.127635 Apr 13 19:18:58 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 271/815] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:18:58 2023] DELETE /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-1b8eaf3a-a332-4697-89a9-d14aab2080ec tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-1b8eaf3a-a332-4697-89a9-d14aab2080ec tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1b8eaf3a-a332-4697-89a9-d14aab2080ec tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1b8eaf3a-a332-4697-89a9-d14aab2080ec tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1b8eaf3a-a332-4697-89a9-d14aab2080ec tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1b8eaf3a-a332-4697-89a9-d14aab2080ec tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1b8eaf3a-a332-4697-89a9-d14aab2080ec tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1b8eaf3a-a332-4697-89a9-d14aab2080ec tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:18:58 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-1b8eaf3a-a332-4697-89a9-d14aab2080ec tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789fdd98ede74e6783b667178c2689fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024f13d8c179482791ed1545b6b2efd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:18:58 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-1b8eaf3a-a332-4697-89a9-d14aab2080ec tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a" status: 200 len: 1546 microversion: 2.1 time: 0.156948 Apr 13 19:18:58 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 271/816] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:18:58 2023] GET /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:19:00 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-3bd8e87a-2e69-4a13-ac8c-6ac435e35ad5 req-491761ba-dd58-4a17-bdca-ba74ae0842da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166341f7-a5fa-4034-8281-6aed0be1bd5a", "name": "network-vif-unplugged", "status": "completed", "tag": "3e4a73da-8c31-4a03-a16a-69ff3f84b550"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-3bd8e87a-2e69-4a13-ac8c-6ac435e35ad5 req-491761ba-dd58-4a17-bdca-ba74ae0842da service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-3bd8e87a-2e69-4a13-ac8c-6ac435e35ad5 req-491761ba-dd58-4a17-bdca-ba74ae0842da service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-3bd8e87a-2e69-4a13-ac8c-6ac435e35ad5 req-491761ba-dd58-4a17-bdca-ba74ae0842da service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:00 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-3bd8e87a-2e69-4a13-ac8c-6ac435e35ad5 req-491761ba-dd58-4a17-bdca-ba74ae0842da service nova] Creating event network-vif-unplugged:3e4a73da-8c31-4a03-a16a-69ff3f84b550 for instance 166341f7-a5fa-4034-8281-6aed0be1bd5a on user Apr 13 19:19:00 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-3bd8e87a-2e69-4a13-ac8c-6ac435e35ad5 req-491761ba-dd58-4a17-bdca-ba74ae0842da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080388 Apr 13 19:19:00 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 275/817] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:01 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-1589c9d2-289f-41d9-a6c5-bbf71d9b1b2d req-df7629b1-a4e3-4f00-9ea8-12645eff116d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166341f7-a5fa-4034-8281-6aed0be1bd5a", "name": "network-vif-deleted", "tag": "3e4a73da-8c31-4a03-a16a-69ff3f84b550"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1589c9d2-289f-41d9-a6c5-bbf71d9b1b2d req-df7629b1-a4e3-4f00-9ea8-12645eff116d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1589c9d2-289f-41d9-a6c5-bbf71d9b1b2d req-df7629b1-a4e3-4f00-9ea8-12645eff116d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1589c9d2-289f-41d9-a6c5-bbf71d9b1b2d req-df7629b1-a4e3-4f00-9ea8-12645eff116d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:01 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-1589c9d2-289f-41d9-a6c5-bbf71d9b1b2d req-df7629b1-a4e3-4f00-9ea8-12645eff116d service nova] Creating event network-vif-deleted:3e4a73da-8c31-4a03-a16a-69ff3f84b550 for instance 166341f7-a5fa-4034-8281-6aed0be1bd5a on user Apr 13 19:19:01 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-1589c9d2-289f-41d9-a6c5-bbf71d9b1b2d req-df7629b1-a4e3-4f00-9ea8-12645eff116d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033501 Apr 13 19:19:01 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 272/818] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-6d81173e-9622-4cf5-84e7-650548f411b6 req-a8efb6e4-840d-4cff-a173-b1f9b02472d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166341f7-a5fa-4034-8281-6aed0be1bd5a", "name": "network-vif-plugged", "status": "completed", "tag": "3e4a73da-8c31-4a03-a16a-69ff3f84b550"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-6d81173e-9622-4cf5-84e7-650548f411b6 req-a8efb6e4-840d-4cff-a173-b1f9b02472d8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-6d81173e-9622-4cf5-84e7-650548f411b6 req-a8efb6e4-840d-4cff-a173-b1f9b02472d8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-6d81173e-9622-4cf5-84e7-650548f411b6 req-a8efb6e4-840d-4cff-a173-b1f9b02472d8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-6d81173e-9622-4cf5-84e7-650548f411b6 req-a8efb6e4-840d-4cff-a173-b1f9b02472d8 service nova] Creating event network-vif-plugged:3e4a73da-8c31-4a03-a16a-69ff3f84b550 for instance 166341f7-a5fa-4034-8281-6aed0be1bd5a on user Apr 13 19:19:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-6d81173e-9622-4cf5-84e7-650548f411b6 req-a8efb6e4-840d-4cff-a173-b1f9b02472d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030971 Apr 13 19:19:02 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 272/819] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:12 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:19:12 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:19:12 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080204b2-fd4d-4224-b391-a27036d058ac", "tag": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:12 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] Creating event network-changed:a29956b4-c9c2-4c86-bf4a-488fb5f45af0 for instance 080204b2-fd4d-4224-b391-a27036d058ac on user Apr 13 19:19:12 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038888 Apr 13 19:19:12 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 276/820] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:14 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:19:14 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:19:14 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:14 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:14 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Going to try to terminate instance {{(pid=61589) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:19:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac" status: 204 len: 0 microversion: 2.1 time: 0.229355 Apr 13 19:19:15 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 273/821] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:19:14 2023] DELETE /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:19:15 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-69ba3ca7-21ca-41af-8499-543e7de5f751 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:15 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-69ba3ca7-21ca-41af-8499-543e7de5f751 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:15 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=10 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:19:15 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=22 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:19:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-69ba3ca7-21ca-41af-8499-543e7de5f751 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-69ba3ca7-21ca-41af-8499-543e7de5f751 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-69ba3ca7-21ca-41af-8499-543e7de5f751 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-69ba3ca7-21ca-41af-8499-543e7de5f751 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-69ba3ca7-21ca-41af-8499-543e7de5f751 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:15 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-69ba3ca7-21ca-41af-8499-543e7de5f751 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:15 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-69ba3ca7-21ca-41af-8499-543e7de5f751 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dea69daeb2475f84b5a46821288be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b7cc9c0ba145bea0585e887a92c788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:19:15 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-69ba3ca7-21ca-41af-8499-543e7de5f751 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac" status: 200 len: 1571 microversion: 2.1 time: 0.214357 Apr 13 19:19:15 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 273/822] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:19:15 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac => generated 1571 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:19:15 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-dd3f260b-12db-42a3-9612-f8ddccac0770 req-05287e20-c8cc-419f-8de9-e688a71620e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080204b2-fd4d-4224-b391-a27036d058ac", "name": "network-vif-unplugged", "status": "completed", "tag": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dd3f260b-12db-42a3-9612-f8ddccac0770 req-05287e20-c8cc-419f-8de9-e688a71620e0 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dd3f260b-12db-42a3-9612-f8ddccac0770 req-05287e20-c8cc-419f-8de9-e688a71620e0 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dd3f260b-12db-42a3-9612-f8ddccac0770 req-05287e20-c8cc-419f-8de9-e688a71620e0 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-dd3f260b-12db-42a3-9612-f8ddccac0770 req-05287e20-c8cc-419f-8de9-e688a71620e0 service nova] Creating event network-vif-unplugged:a29956b4-c9c2-4c86-bf4a-488fb5f45af0 for instance 080204b2-fd4d-4224-b391-a27036d058ac on user Apr 13 19:19:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-dd3f260b-12db-42a3-9612-f8ddccac0770 req-05287e20-c8cc-419f-8de9-e688a71620e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038029 Apr 13 19:19:15 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 277/823] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:19:16 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-c5d71e59-1aa4-44c5-be8d-2a29ee545fe3 req-fabe78a0-b216-455b-ae6a-39b31ca2bb60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080204b2-fd4d-4224-b391-a27036d058ac", "name": "network-vif-deleted", "tag": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c5d71e59-1aa4-44c5-be8d-2a29ee545fe3 req-fabe78a0-b216-455b-ae6a-39b31ca2bb60 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c5d71e59-1aa4-44c5-be8d-2a29ee545fe3 req-fabe78a0-b216-455b-ae6a-39b31ca2bb60 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c5d71e59-1aa4-44c5-be8d-2a29ee545fe3 req-fabe78a0-b216-455b-ae6a-39b31ca2bb60 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-c5d71e59-1aa4-44c5-be8d-2a29ee545fe3 req-fabe78a0-b216-455b-ae6a-39b31ca2bb60 service nova] Creating event network-vif-deleted:a29956b4-c9c2-4c86-bf4a-488fb5f45af0 for instance 080204b2-fd4d-4224-b391-a27036d058ac on user Apr 13 19:19:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-c5d71e59-1aa4-44c5-be8d-2a29ee545fe3 req-fabe78a0-b216-455b-ae6a-39b31ca2bb60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049823 Apr 13 19:19:16 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 274/824] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:17 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-28c2f8a1-e021-4fc5-aa49-6b884afdfe39 req-0afe0b4d-a5ad-42d6-9eb2-f04470c233f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080204b2-fd4d-4224-b391-a27036d058ac", "name": "network-vif-plugged", "status": "completed", "tag": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-28c2f8a1-e021-4fc5-aa49-6b884afdfe39 req-0afe0b4d-a5ad-42d6-9eb2-f04470c233f3 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-28c2f8a1-e021-4fc5-aa49-6b884afdfe39 req-0afe0b4d-a5ad-42d6-9eb2-f04470c233f3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-28c2f8a1-e021-4fc5-aa49-6b884afdfe39 req-0afe0b4d-a5ad-42d6-9eb2-f04470c233f3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:17 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-28c2f8a1-e021-4fc5-aa49-6b884afdfe39 req-0afe0b4d-a5ad-42d6-9eb2-f04470c233f3 service nova] Creating event network-vif-plugged:a29956b4-c9c2-4c86-bf4a-488fb5f45af0 for instance 080204b2-fd4d-4224-b391-a27036d058ac on user Apr 13 19:19:17 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-28c2f8a1-e021-4fc5-aa49-6b884afdfe39 req-0afe0b4d-a5ad-42d6-9eb2-f04470c233f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028627 Apr 13 19:19:17 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 274/825] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:18 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1994d28c-013b-4aac-8db5-3bce0bc271ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:18 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-1994d28c-013b-4aac-8db5-3bce0bc271ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1994d28c-013b-4aac-8db5-3bce0bc271ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1994d28c-013b-4aac-8db5-3bce0bc271ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1994d28c-013b-4aac-8db5-3bce0bc271ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1994d28c-013b-4aac-8db5-3bce0bc271ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1994d28c-013b-4aac-8db5-3bce0bc271ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:18 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1994d28c-013b-4aac-8db5-3bce0bc271ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:18 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-1994d28c-013b-4aac-8db5-3bce0bc271ee tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.091074 Apr 13 19:19:18 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 278/826] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 19:19:18 2023] GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:19 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "620bc9c9-26a0-461f-8771-418b3e9aea79", "tag": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] Creating event network-changed:96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance 620bc9c9-26a0-461f-8771-418b3e9aea79 on user Apr 13 19:19:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032964 Apr 13 19:19:19 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 275/827] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:19 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-58de8e7a-2b7e-4ed0-9829-e98fa1709acb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:19 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-58de8e7a-2b7e-4ed0-9829-e98fa1709acb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-58de8e7a-2b7e-4ed0-9829-e98fa1709acb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-58de8e7a-2b7e-4ed0-9829-e98fa1709acb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-58de8e7a-2b7e-4ed0-9829-e98fa1709acb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-58de8e7a-2b7e-4ed0-9829-e98fa1709acb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-58de8e7a-2b7e-4ed0-9829-e98fa1709acb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-58de8e7a-2b7e-4ed0-9829-e98fa1709acb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:19 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-58de8e7a-2b7e-4ed0-9829-e98fa1709acb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/ips" status: 200 len: 108 microversion: 2.1 time: 0.036605 Apr 13 19:19:19 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 275/828] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 19:19:19 2023] GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/ips => generated 108 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:21 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "594cd591-f422-47d5-bcc8-1a73383abd82"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:21 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:21 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:21 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272173 Apr 13 19:19:21 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 279/829] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:19:21 2023] POST /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:28 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-abc7081b-183c-4dae-a7bc-c4a8526e87e1 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "594cd591-f422-47d5-bcc8-1a73383abd82"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:28 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-abc7081b-183c-4dae-a7bc-c4a8526e87e1 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-abc7081b-183c-4dae-a7bc-c4a8526e87e1 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-abc7081b-183c-4dae-a7bc-c4a8526e87e1 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-abc7081b-183c-4dae-a7bc-c4a8526e87e1 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-abc7081b-183c-4dae-a7bc-c4a8526e87e1 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-abc7081b-183c-4dae-a7bc-c4a8526e87e1 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-abc7081b-183c-4dae-a7bc-c4a8526e87e1 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:29 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-abc7081b-183c-4dae-a7bc-c4a8526e87e1 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Invalid volume: volume 594cd591-f422-47d5-bcc8-1a73383abd82 is already attached to instances: 620bc9c9-26a0-461f-8771-418b3e9aea79 Apr 13 19:19:29 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-abc7081b-183c-4dae-a7bc-c4a8526e87e1 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:19:29 user devstack@n-api.service[61589]: request: POST /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-volume_attachments HTTP/1.1 Apr 13 19:19:29 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:19:29 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:19:29 user devstack@n-api.service[61589]: Connection: close Apr 13 19:19:29 user devstack@n-api.service[61589]: Content-Length: 74 Apr 13 19:19:29 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:19:29 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:19:29 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:19:29 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:19:29 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:19:29 user devstack@n-api.service[61589]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:19:29 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:19:29 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:19:29 user devstack@n-api.service[61589]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:19:29 user devstack@n-api.service[61589]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:19:29 user devstack@n-api.service[61589]: Apr 13 19:19:29 user devstack@n-api.service[61589]: {"volumeAttachment": {"volumeId": "594cd591-f422-47d5-bcc8-1a73383abd82"}} Apr 13 19:19:29 user devstack@n-api.service[61589]: method: > Apr 13 19:19:29 user devstack@n-api.service[61589]: exception: Invalid volume: volume 594cd591-f422-47d5-bcc8-1a73383abd82 is already attached to instances: 620bc9c9-26a0-461f-8771-418b3e9aea79 Apr 13 19:19:29 user devstack@n-api.service[61589]: action_args: {'server_id': '620bc9c9-26a0-461f-8771-418b3e9aea79', 'body': {'volumeAttachment': {'volumeId': '594cd591-f422-47d5-bcc8-1a73383abd82'}}} Apr 13 19:19:29 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 594cd591-f422-47d5-bcc8-1a73383abd82 is already attached to instances: 620bc9c9-26a0-461f-8771-418b3e9aea79 Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 594cd591-f422-47d5-bcc8-1a73383abd82 is already attached to instances: 620bc9c9-26a0-461f-8771-418b3e9aea79 Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 594cd591-f422-47d5-bcc8-1a73383abd82 is already attached to instances: 620bc9c9-26a0-461f-8771-418b3e9aea79 Apr 13 19:19:29 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:19:29 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-abc7081b-183c-4dae-a7bc-c4a8526e87e1 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 400 to user: Invalid volume: volume 594cd591-f422-47d5-bcc8-1a73383abd82 is already attached to instances: 620bc9c9-26a0-461f-8771-418b3e9aea79 {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:19:29 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-abc7081b-183c-4dae-a7bc-c4a8526e87e1 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102178 Apr 13 19:19:29 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 276/830] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:19:28 2023] POST /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:19:29 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:29 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:29 user devstack@n-api.service[61588]: DEBUG nova.objects.instance [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'services' on Instance uuid 620bc9c9-26a0-461f-8771-418b3e9aea79 {{(pid=61588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:19:29 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-volume_attachments/594cd591-f422-47d5-bcc8-1a73383abd82" status: 202 len: 0 microversion: 2.1 time: 0.154711 Apr 13 19:19:29 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 276/831] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:19:29 2023] DELETE /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-volume_attachments/594cd591-f422-47d5-bcc8-1a73383abd82 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:19:29 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-07705fd8-0df2-4b0d-923f-3cfda2e84865 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:29 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-07705fd8-0df2-4b0d-923f-3cfda2e84865 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07705fd8-0df2-4b0d-923f-3cfda2e84865 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07705fd8-0df2-4b0d-923f-3cfda2e84865 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07705fd8-0df2-4b0d-923f-3cfda2e84865 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07705fd8-0df2-4b0d-923f-3cfda2e84865 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07705fd8-0df2-4b0d-923f-3cfda2e84865 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-07705fd8-0df2-4b0d-923f-3cfda2e84865 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:29 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-07705fd8-0df2-4b0d-923f-3cfda2e84865 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062117 Apr 13 19:19:29 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 280/832] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:19:29 2023] GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:38 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:38 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:38 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Going to try to terminate instance {{(pid=61589) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:19:38 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 204 len: 0 microversion: 2.1 time: 0.125271 Apr 13 19:19:38 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 277/833] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:19:38 2023] DELETE /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:19:38 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-56a0e531-9119-4473-b203-d76023cba691 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:38 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-56a0e531-9119-4473-b203-d76023cba691 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-56a0e531-9119-4473-b203-d76023cba691 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-56a0e531-9119-4473-b203-d76023cba691 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-56a0e531-9119-4473-b203-d76023cba691 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-56a0e531-9119-4473-b203-d76023cba691 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-56a0e531-9119-4473-b203-d76023cba691 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:38 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-56a0e531-9119-4473-b203-d76023cba691 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:38 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-56a0e531-9119-4473-b203-d76023cba691 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:19:38 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-56a0e531-9119-4473-b203-d76023cba691 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 200 len: 1550 microversion: 2.1 time: 0.157643 Apr 13 19:19:38 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 277/834] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:19:38 2023] GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:19:38 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-51fa103d-0d31-43fb-83b1-8034f8b0f17b req-0847c7c4-c2d6-43bc-af61-29c5c01f7a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-unplugged", "status": "completed", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-51fa103d-0d31-43fb-83b1-8034f8b0f17b req-0847c7c4-c2d6-43bc-af61-29c5c01f7a9b service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-51fa103d-0d31-43fb-83b1-8034f8b0f17b req-0847c7c4-c2d6-43bc-af61-29c5c01f7a9b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-51fa103d-0d31-43fb-83b1-8034f8b0f17b req-0847c7c4-c2d6-43bc-af61-29c5c01f7a9b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:38 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-51fa103d-0d31-43fb-83b1-8034f8b0f17b req-0847c7c4-c2d6-43bc-af61-29c5c01f7a9b service nova] Creating event network-vif-unplugged:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:19:38 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-51fa103d-0d31-43fb-83b1-8034f8b0f17b req-0847c7c4-c2d6-43bc-af61-29c5c01f7a9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029607 Apr 13 19:19:38 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 281/835] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:40 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-5a111595-b78d-48fb-8481-666e7a26ba22 req-6c6ae53a-9e67-41f1-9ebd-165c003f5ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-deleted", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-5a111595-b78d-48fb-8481-666e7a26ba22 req-6c6ae53a-9e67-41f1-9ebd-165c003f5ecf service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-5a111595-b78d-48fb-8481-666e7a26ba22 req-6c6ae53a-9e67-41f1-9ebd-165c003f5ecf service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-5a111595-b78d-48fb-8481-666e7a26ba22 req-6c6ae53a-9e67-41f1-9ebd-165c003f5ecf service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:40 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-5a111595-b78d-48fb-8481-666e7a26ba22 req-6c6ae53a-9e67-41f1-9ebd-165c003f5ecf service nova] Creating event network-vif-deleted:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:19:40 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-5a111595-b78d-48fb-8481-666e7a26ba22 req-6c6ae53a-9e67-41f1-9ebd-165c003f5ecf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030592 Apr 13 19:19:40 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 278/836] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:41 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-plugged", "status": "completed", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}, {"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-plugged", "status": "completed", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}, {"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-plugged", "status": "completed", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}, {"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-unplugged", "status": "completed", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}, {"server_uuid": "a9f3d080-a163-4897-9187-2687cae49694", "name": "network-vif-plugged", "status": "completed", "tag": "2207b77c-fc08-471c-8281-cd1f6061ea54"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:41 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Creating event network-vif-plugged:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:19:41 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Creating event network-vif-plugged:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:19:41 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Creating event network-vif-plugged:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:19:41 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Creating event network-vif-unplugged:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:19:41 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Creating event network-vif-plugged:2207b77c-fc08-471c-8281-cd1f6061ea54 for instance a9f3d080-a163-4897-9187-2687cae49694 on user Apr 13 19:19:41 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034129 Apr 13 19:19:41 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 278/837] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:41 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-036ad8fe-f637-4253-9422-be4a3db1ad54 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:42 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-036ad8fe-f637-4253-9422-be4a3db1ad54 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:42 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=13 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:19:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-036ad8fe-f637-4253-9422-be4a3db1ad54 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-036ad8fe-f637-4253-9422-be4a3db1ad54 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-036ad8fe-f637-4253-9422-be4a3db1ad54 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-036ad8fe-f637-4253-9422-be4a3db1ad54 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-036ad8fe-f637-4253-9422-be4a3db1ad54 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-036ad8fe-f637-4253-9422-be4a3db1ad54 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:42 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:19:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-036ad8fe-f637-4253-9422-be4a3db1ad54 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] HTTP exception thrown: Instance 01bd39f7-7d27-48cf-982e-181aadc060ab could not be found. Apr 13 19:19:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-036ad8fe-f637-4253-9422-be4a3db1ad54 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Request method failure captured: Apr 13 19:19:42 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab HTTP/1.1 Apr 13 19:19:42 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:19:42 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:19:42 user devstack@n-api.service[61587]: Connection: close Apr 13 19:19:42 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:19:42 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:19:42 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:19:42 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:19:42 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFIW5I_A2oi7_fnWAXup5bR_1v4_NxI2GY1J1uY5nA0Rpx18iBmtG3f0vrXqcApPhKfHUi1pI15fOYoO4JzcqVLkugFjbCLEnhTIfLFsB4wc3App5vw0u0L75IqNFxG2VAhF9UVebRhkjPsHR1_2ogh-T-bEdLq7RR3AuJbhokeecMs Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Project-Id: 42fbd7089a7e4ba8b2597fca0d8e84c8 Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}] Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Tenant-Id: 42fbd7089a7e4ba8b2597fca0d8e84c8 Apr 13 19:19:42 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:19:42 user devstack@n-api.service[61587]: X-User: tempest-ServerRescueNegativeTestJSON-1255770111-project-member Apr 13 19:19:42 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:19:42 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:19:42 user devstack@n-api.service[61587]: X-User-Id: 3bebf61a7401492692f9c60adde178f7 Apr 13 19:19:42 user devstack@n-api.service[61587]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255770111-project-member Apr 13 19:19:42 user devstack@n-api.service[61587]: method: > Apr 13 19:19:42 user devstack@n-api.service[61587]: exception: Instance 01bd39f7-7d27-48cf-982e-181aadc060ab could not be found. Apr 13 19:19:42 user devstack@n-api.service[61587]: action_args: {'id': '01bd39f7-7d27-48cf-982e-181aadc060ab'} Apr 13 19:19:42 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01bd39f7-7d27-48cf-982e-181aadc060ab could not be found. Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01bd39f7-7d27-48cf-982e-181aadc060ab could not be found. Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01bd39f7-7d27-48cf-982e-181aadc060ab could not be found. Apr 13 19:19:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:19:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-036ad8fe-f637-4253-9422-be4a3db1ad54 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Returning 404 to user: Instance 01bd39f7-7d27-48cf-982e-181aadc060ab could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:19:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-036ad8fe-f637-4253-9422-be4a3db1ad54 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab" status: 404 len: 111 microversion: 2.1 time: 0.036649 Apr 13 19:19:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 282/838] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:19:42 2023] GET /compute/v2.1/servers/01bd39f7-7d27-48cf-982e-181aadc060ab => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:19:42 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-86bc1c78-f715-4364-bb04-2e95955949de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '.version_select at 0x7efe33d5f7f0>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:42 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-86bc1c78-f715-4364-bb04-2e95955949de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767392597" status: 202 len: 0 microversion: 2.1 time: 0.033472 Apr 13 19:19:42 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 279/839] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 19:19:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767392597 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:19:48 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-48eada12-c664-40f4-9acd-03dbd6de0273 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:48 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-48eada12-c664-40f4-9acd-03dbd6de0273 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:48 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=13 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:19:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-48eada12-c664-40f4-9acd-03dbd6de0273 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-48eada12-c664-40f4-9acd-03dbd6de0273 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-48eada12-c664-40f4-9acd-03dbd6de0273 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-48eada12-c664-40f4-9acd-03dbd6de0273 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-48eada12-c664-40f4-9acd-03dbd6de0273 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-48eada12-c664-40f4-9acd-03dbd6de0273 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:48 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:19:48 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-48eada12-c664-40f4-9acd-03dbd6de0273 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] HTTP exception thrown: Instance 166341f7-a5fa-4034-8281-6aed0be1bd5a could not be found. Apr 13 19:19:48 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-48eada12-c664-40f4-9acd-03dbd6de0273 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Request method failure captured: Apr 13 19:19:48 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a HTTP/1.1 Apr 13 19:19:48 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:19:48 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:19:48 user devstack@n-api.service[61588]: Connection: close Apr 13 19:19:48 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:19:48 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:19:48 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:19:48 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:19:48 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFUVALxAVSj7D_A0cCVR7KCnn8HScFE27Eq7c2IB3ZsjkA6BQG-avT171U1kAk02x-Uw6J-twmhILqFnPw8-C5AGU_t_hq4dqJ_fiyZP5oBeudpKXnmGKHVq5YpJyJ7xZCrypJvPTVl0HHUNcj0bb3G14TdRLXRlLoVZAALjPQl8VVU Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Project-Id: 024f13d8c179482791ed1545b6b2efd8 Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Project-Name: tempest-VolumesSnapshotTestJSON-613917248 Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024f13d8c179482791ed1545b6b2efd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/024f13d8c179482791ed1545b6b2efd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024f13d8c179482791ed1545b6b2efd8"}]}] Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Tenant: tempest-VolumesSnapshotTestJSON-613917248 Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Tenant-Id: 024f13d8c179482791ed1545b6b2efd8 Apr 13 19:19:48 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-613917248 Apr 13 19:19:48 user devstack@n-api.service[61588]: X-User: tempest-VolumesSnapshotTestJSON-613917248-project-member Apr 13 19:19:48 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:19:48 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:19:48 user devstack@n-api.service[61588]: X-User-Id: 789fdd98ede74e6783b667178c2689fb Apr 13 19:19:48 user devstack@n-api.service[61588]: X-User-Name: tempest-VolumesSnapshotTestJSON-613917248-project-member Apr 13 19:19:48 user devstack@n-api.service[61588]: method: > Apr 13 19:19:48 user devstack@n-api.service[61588]: exception: Instance 166341f7-a5fa-4034-8281-6aed0be1bd5a could not be found. Apr 13 19:19:48 user devstack@n-api.service[61588]: action_args: {'id': '166341f7-a5fa-4034-8281-6aed0be1bd5a'} Apr 13 19:19:48 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 166341f7-a5fa-4034-8281-6aed0be1bd5a could not be found. Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 166341f7-a5fa-4034-8281-6aed0be1bd5a could not be found. Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 166341f7-a5fa-4034-8281-6aed0be1bd5a could not be found. Apr 13 19:19:48 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:19:48 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-48eada12-c664-40f4-9acd-03dbd6de0273 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Returning 404 to user: Instance 166341f7-a5fa-4034-8281-6aed0be1bd5a could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:19:48 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-48eada12-c664-40f4-9acd-03dbd6de0273 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a" status: 404 len: 111 microversion: 2.1 time: 0.035144 Apr 13 19:19:48 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 279/840] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:19:48 2023] GET /compute/v2.1/servers/166341f7-a5fa-4034-8281-6aed0be1bd5a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:19:48 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:48 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:48 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:19:49 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df" status: 204 len: 0 microversion: 2.1 time: 0.128510 Apr 13 19:19:49 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 283/841] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:19:48 2023] DELETE /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:19:49 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-a8a7bb2c-c72a-403f-94b6-b7685b69d1f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:49 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-a8a7bb2c-c72a-403f-94b6-b7685b69d1f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:49 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:19:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a8a7bb2c-c72a-403f-94b6-b7685b69d1f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a8a7bb2c-c72a-403f-94b6-b7685b69d1f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a8a7bb2c-c72a-403f-94b6-b7685b69d1f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a8a7bb2c-c72a-403f-94b6-b7685b69d1f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a8a7bb2c-c72a-403f-94b6-b7685b69d1f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a8a7bb2c-c72a-403f-94b6-b7685b69d1f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:49 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:19:49 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-a8a7bb2c-c72a-403f-94b6-b7685b69d1f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:19:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-a8a7bb2c-c72a-403f-94b6-b7685b69d1f2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df" status: 200 len: 1496 microversion: 2.1 time: 0.263041 Apr 13 19:19:49 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 280/842] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:19:49 2023] GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df => generated 1496 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:19:49 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-6485638f-c730-454b-81f1-7cc6e491e841 req-b3ecc6af-2a47-4869-83f4-631b3740a0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d7b86a-c723-4255-827e-2f6a641239df", "name": "network-vif-unplugged", "status": "completed", "tag": "3de4b459-2a9f-4570-80b1-dce61f40a377"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-6485638f-c730-454b-81f1-7cc6e491e841 req-b3ecc6af-2a47-4869-83f4-631b3740a0a8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-6485638f-c730-454b-81f1-7cc6e491e841 req-b3ecc6af-2a47-4869-83f4-631b3740a0a8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-6485638f-c730-454b-81f1-7cc6e491e841 req-b3ecc6af-2a47-4869-83f4-631b3740a0a8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:49 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-6485638f-c730-454b-81f1-7cc6e491e841 req-b3ecc6af-2a47-4869-83f4-631b3740a0a8 service nova] Creating event network-vif-unplugged:3de4b459-2a9f-4570-80b1-dce61f40a377 for instance 59d7b86a-c723-4255-827e-2f6a641239df on user Apr 13 19:19:49 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-6485638f-c730-454b-81f1-7cc6e491e841 req-b3ecc6af-2a47-4869-83f4-631b3740a0a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034398 Apr 13 19:19:49 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 280/843] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:19:50 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-6d7ea0fa-7e49-4d47-858e-f8280abde990 req-075af2a6-fae8-4008-967c-5bedbf6bc2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d7b86a-c723-4255-827e-2f6a641239df", "name": "network-vif-deleted", "tag": "3de4b459-2a9f-4570-80b1-dce61f40a377"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6d7ea0fa-7e49-4d47-858e-f8280abde990 req-075af2a6-fae8-4008-967c-5bedbf6bc2df service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6d7ea0fa-7e49-4d47-858e-f8280abde990 req-075af2a6-fae8-4008-967c-5bedbf6bc2df service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6d7ea0fa-7e49-4d47-858e-f8280abde990 req-075af2a6-fae8-4008-967c-5bedbf6bc2df service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:50 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-6d7ea0fa-7e49-4d47-858e-f8280abde990 req-075af2a6-fae8-4008-967c-5bedbf6bc2df service nova] Creating event network-vif-deleted:3de4b459-2a9f-4570-80b1-dce61f40a377 for instance 59d7b86a-c723-4255-827e-2f6a641239df on user Apr 13 19:19:50 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-6d7ea0fa-7e49-4d47-858e-f8280abde990 req-075af2a6-fae8-4008-967c-5bedbf6bc2df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039687 Apr 13 19:19:50 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 284/844] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:19:51 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-737b3246-b2f1-4f7c-98d1-e4ef849e569f req-5d2edb9f-6b5b-4bdf-bd6d-162a9337a85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d7b86a-c723-4255-827e-2f6a641239df", "name": "network-vif-plugged", "status": "completed", "tag": "3de4b459-2a9f-4570-80b1-dce61f40a377"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:51 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-737b3246-b2f1-4f7c-98d1-e4ef849e569f req-5d2edb9f-6b5b-4bdf-bd6d-162a9337a85c service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:51 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-737b3246-b2f1-4f7c-98d1-e4ef849e569f req-5d2edb9f-6b5b-4bdf-bd6d-162a9337a85c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:51 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-737b3246-b2f1-4f7c-98d1-e4ef849e569f req-5d2edb9f-6b5b-4bdf-bd6d-162a9337a85c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:51 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-737b3246-b2f1-4f7c-98d1-e4ef849e569f req-5d2edb9f-6b5b-4bdf-bd6d-162a9337a85c service nova] Creating event network-vif-plugged:3de4b459-2a9f-4570-80b1-dce61f40a377 for instance 59d7b86a-c723-4255-827e-2f6a641239df on user Apr 13 19:19:51 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-737b3246-b2f1-4f7c-98d1-e4ef849e569f req-5d2edb9f-6b5b-4bdf-bd6d-162a9337a85c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029399 Apr 13 19:19:51 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 281/845] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:19:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:19:57 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-609609545", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519"}]}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG nova.network.neutron [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] validate_networks() for [('0e855c73-cf7d-4c09-9fb5-3a4a7903b519', None, None, None, None, None)] {{(pid=61588) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Flavor limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Image limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Flavor pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Image pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Getting quotas for project 024f13d8c179482791ed1545b6b2efd8. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Getting quotas for user 789fdd98ede74e6783b667178c2689fb and project 024f13d8c179482791ed1545b6b2efd8. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Going to run 1 instances... {{(pid=61588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:19:58 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:19:58 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.459292 Apr 13 19:19:58 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 281/846] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:19:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:19:58 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a73636cc-4542-4eb9-9536-adaab43b20d8 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:19:58 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-a73636cc-4542-4eb9-9536-adaab43b20d8 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:19:58 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-a73636cc-4542-4eb9-9536-adaab43b20d8 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789fdd98ede74e6783b667178c2689fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024f13d8c179482791ed1545b6b2efd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:19:58 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a73636cc-4542-4eb9-9536-adaab43b20d8 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8" status: 200 len: 1212 microversion: 2.1 time: 0.070957 Apr 13 19:19:58 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 285/847] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:19:58 2023] GET /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8 => generated 1212 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:20:00 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b98531d-34ae-4f83-930a-3c970727fac8", "tag": "83ef4caf-d717-4e45-9511-cfcc225f7b05"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:20:00 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:00 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:00 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:00 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] Creating event network-changed:83ef4caf-d717-4e45-9511-cfcc225f7b05 for instance 3b98531d-34ae-4f83-930a-3c970727fac8 on user Apr 13 19:20:00 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030494 Apr 13 19:20:00 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 282/848] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:20:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:20:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-0ed6a539-8111-47a7-b393-d073e48814b1 req-088be258-ddd7-4f18-8ef8-737cf1a411a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b98531d-34ae-4f83-930a-3c970727fac8", "name": "network-vif-plugged", "status": "completed", "tag": "83ef4caf-d717-4e45-9511-cfcc225f7b05"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:20:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0ed6a539-8111-47a7-b393-d073e48814b1 req-088be258-ddd7-4f18-8ef8-737cf1a411a5 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0ed6a539-8111-47a7-b393-d073e48814b1 req-088be258-ddd7-4f18-8ef8-737cf1a411a5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0ed6a539-8111-47a7-b393-d073e48814b1 req-088be258-ddd7-4f18-8ef8-737cf1a411a5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0ed6a539-8111-47a7-b393-d073e48814b1 req-088be258-ddd7-4f18-8ef8-737cf1a411a5 service nova] Creating event network-vif-plugged:83ef4caf-d717-4e45-9511-cfcc225f7b05 for instance 3b98531d-34ae-4f83-930a-3c970727fac8 on user Apr 13 19:20:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-0ed6a539-8111-47a7-b393-d073e48814b1 req-088be258-ddd7-4f18-8ef8-737cf1a411a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030159 Apr 13 19:20:02 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 282/849] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:20:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:20:04 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-6b919b65-fa88-4e6f-8672-136ca945d5cf req-0183fc30-170c-4a44-a97e-70507c468999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b98531d-34ae-4f83-930a-3c970727fac8", "name": "network-vif-plugged", "status": "completed", "tag": "83ef4caf-d717-4e45-9511-cfcc225f7b05"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:20:04 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:20:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6b919b65-fa88-4e6f-8672-136ca945d5cf req-0183fc30-170c-4a44-a97e-70507c468999 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6b919b65-fa88-4e6f-8672-136ca945d5cf req-0183fc30-170c-4a44-a97e-70507c468999 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-6b919b65-fa88-4e6f-8672-136ca945d5cf req-0183fc30-170c-4a44-a97e-70507c468999 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:04 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-6b919b65-fa88-4e6f-8672-136ca945d5cf req-0183fc30-170c-4a44-a97e-70507c468999 service nova] Creating event network-vif-plugged:83ef4caf-d717-4e45-9511-cfcc225f7b05 for instance 3b98531d-34ae-4f83-930a-3c970727fac8 on user Apr 13 19:20:04 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-6b919b65-fa88-4e6f-8672-136ca945d5cf req-0183fc30-170c-4a44-a97e-70507c468999 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052334 Apr 13 19:20:04 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 286/850] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:20:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:20:05 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f0b590e8-5199-461e-ab7c-a6dedc5710cf tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:05 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f0b590e8-5199-461e-ab7c-a6dedc5710cf tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f0b590e8-5199-461e-ab7c-a6dedc5710cf tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f0b590e8-5199-461e-ab7c-a6dedc5710cf tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f0b590e8-5199-461e-ab7c-a6dedc5710cf tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f0b590e8-5199-461e-ab7c-a6dedc5710cf tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f0b590e8-5199-461e-ab7c-a6dedc5710cf tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f0b590e8-5199-461e-ab7c-a6dedc5710cf tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:05 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-f0b590e8-5199-461e-ab7c-a6dedc5710cf tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] HTTP exception thrown: Instance 080204b2-fd4d-4224-b391-a27036d058ac could not be found. Apr 13 19:20:05 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f0b590e8-5199-461e-ab7c-a6dedc5710cf tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Request method failure captured: Apr 13 19:20:05 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac HTTP/1.1 Apr 13 19:20:05 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:20:05 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:20:05 user devstack@n-api.service[61589]: Connection: close Apr 13 19:20:05 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:20:05 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:20:05 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:20:05 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:20:05 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFQshFpcRygfxoTV2fbKWQzzZkhFlpYNxTfvQjLITUZqtGUsGnTLwC5L78FV5r2V-nO6ZsHUSLZnI2Hb9jfNg_eVkG32NzYfH6N2LaX-SGF0ofqFoUGa_Mwp4tyN8CoQFXleICQwK0phj3UUgH2z036isWPtdgf4khzdpfEE-1QfRgk Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Project-Id: a0b7cc9c0ba145bea0585e887a92c788 Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Project-Name: tempest-SnapshotDataIntegrityTests-679043734 Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0b7cc9c0ba145bea0585e887a92c788"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0b7cc9c0ba145bea0585e887a92c788"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0b7cc9c0ba145bea0585e887a92c788"}]}] Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Tenant: tempest-SnapshotDataIntegrityTests-679043734 Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Tenant-Id: a0b7cc9c0ba145bea0585e887a92c788 Apr 13 19:20:05 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-679043734 Apr 13 19:20:05 user devstack@n-api.service[61589]: X-User: tempest-SnapshotDataIntegrityTests-679043734-project-member Apr 13 19:20:05 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:20:05 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:20:05 user devstack@n-api.service[61589]: X-User-Id: 60dea69daeb2475f84b5a46821288be9 Apr 13 19:20:05 user devstack@n-api.service[61589]: X-User-Name: tempest-SnapshotDataIntegrityTests-679043734-project-member Apr 13 19:20:05 user devstack@n-api.service[61589]: method: > Apr 13 19:20:05 user devstack@n-api.service[61589]: exception: Instance 080204b2-fd4d-4224-b391-a27036d058ac could not be found. Apr 13 19:20:05 user devstack@n-api.service[61589]: action_args: {'id': '080204b2-fd4d-4224-b391-a27036d058ac'} Apr 13 19:20:05 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 080204b2-fd4d-4224-b391-a27036d058ac could not be found. Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 080204b2-fd4d-4224-b391-a27036d058ac could not be found. Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 080204b2-fd4d-4224-b391-a27036d058ac could not be found. Apr 13 19:20:05 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:20:05 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f0b590e8-5199-461e-ab7c-a6dedc5710cf tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Returning 404 to user: Instance 080204b2-fd4d-4224-b391-a27036d058ac could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:20:05 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f0b590e8-5199-461e-ab7c-a6dedc5710cf tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac" status: 404 len: 111 microversion: 2.1 time: 0.031592 Apr 13 19:20:05 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 283/851] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:20:05 2023] GET /compute/v2.1/servers/080204b2-fd4d-4224-b391-a27036d058ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:20:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-3b2848c5-d398-4508-b571-22f2c661e29a tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Calling method '.version_select at 0x7efe33eab490>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-3b2848c5-d398-4508-b571-22f2c661e29a tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1182290909" status: 202 len: 0 microversion: 2.1 time: 0.022265 Apr 13 19:20:05 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 283/852] 10.0.0.210 () {62 vars in 1355 bytes} [Thu Apr 13 19:20:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1182290909 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ec2508c5-842d-437b-a746-69d8da611a8d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-ec2508c5-842d-437b-a746-69d8da611a8d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ec2508c5-842d-437b-a746-69d8da611a8d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ec2508c5-842d-437b-a746-69d8da611a8d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ec2508c5-842d-437b-a746-69d8da611a8d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ec2508c5-842d-437b-a746-69d8da611a8d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ec2508c5-842d-437b-a746-69d8da611a8d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ec2508c5-842d-437b-a746-69d8da611a8d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-ec2508c5-842d-437b-a746-69d8da611a8d tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049582 Apr 13 19:20:19 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 287/853] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:20:19 2023] GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:20:19 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:19 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:19 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=7 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:20:19 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=11 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:20:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:19 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Going to try to terminate instance {{(pid=61589) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:20:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79" status: 204 len: 0 microversion: 2.1 time: 0.119304 Apr 13 19:20:19 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 284/854] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:20:19 2023] DELETE /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=7 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-37b14d98-7821-489d-bbf4-c847a2e4d208 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-37b14d98-7821-489d-bbf4-c847a2e4d208 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37b14d98-7821-489d-bbf4-c847a2e4d208 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37b14d98-7821-489d-bbf4-c847a2e4d208 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37b14d98-7821-489d-bbf4-c847a2e4d208 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37b14d98-7821-489d-bbf4-c847a2e4d208 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37b14d98-7821-489d-bbf4-c847a2e4d208 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-37b14d98-7821-489d-bbf4-c847a2e4d208 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:19 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-37b14d98-7821-489d-bbf4-c847a2e4d208 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:20:19 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-37b14d98-7821-489d-bbf4-c847a2e4d208 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79" status: 200 len: 1667 microversion: 2.1 time: 0.238503 Apr 13 19:20:19 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 284/855] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:20:19 2023] GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79 => generated 1667 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-4e52f28a-4136-40c9-b71f-8c2a5982a4e1 req-9af23ed2-9bb4-4ee9-b412-8112db1b8a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620bc9c9-26a0-461f-8771-418b3e9aea79", "name": "network-vif-unplugged", "status": "completed", "tag": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4e52f28a-4136-40c9-b71f-8c2a5982a4e1 req-9af23ed2-9bb4-4ee9-b412-8112db1b8a63 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4e52f28a-4136-40c9-b71f-8c2a5982a4e1 req-9af23ed2-9bb4-4ee9-b412-8112db1b8a63 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4e52f28a-4136-40c9-b71f-8c2a5982a4e1 req-9af23ed2-9bb4-4ee9-b412-8112db1b8a63 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-4e52f28a-4136-40c9-b71f-8c2a5982a4e1 req-9af23ed2-9bb4-4ee9-b412-8112db1b8a63 service nova] Creating event network-vif-unplugged:96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance 620bc9c9-26a0-461f-8771-418b3e9aea79 on user Apr 13 19:20:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-4e52f28a-4136-40c9-b71f-8c2a5982a4e1 req-9af23ed2-9bb4-4ee9-b412-8112db1b8a63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053286 Apr 13 19:20:19 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 288/856] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:20:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:20:21 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-d8878abe-007f-4a02-818d-0860bb3775d8 req-5a6601f1-c176-4af6-b8ad-6091a5149aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620bc9c9-26a0-461f-8771-418b3e9aea79", "name": "network-vif-deleted", "tag": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:20:21 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-d8878abe-007f-4a02-818d-0860bb3775d8 req-5a6601f1-c176-4af6-b8ad-6091a5149aa3 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:21 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-d8878abe-007f-4a02-818d-0860bb3775d8 req-5a6601f1-c176-4af6-b8ad-6091a5149aa3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:21 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-d8878abe-007f-4a02-818d-0860bb3775d8 req-5a6601f1-c176-4af6-b8ad-6091a5149aa3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:21 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-d8878abe-007f-4a02-818d-0860bb3775d8 req-5a6601f1-c176-4af6-b8ad-6091a5149aa3 service nova] Creating event network-vif-deleted:96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance 620bc9c9-26a0-461f-8771-418b3e9aea79 on user Apr 13 19:20:21 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-d8878abe-007f-4a02-818d-0860bb3775d8 req-5a6601f1-c176-4af6-b8ad-6091a5149aa3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031839 Apr 13 19:20:21 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 285/857] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:20:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:20:21 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620bc9c9-26a0-461f-8771-418b3e9aea79", "name": "network-vif-plugged", "status": "completed", "tag": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf"}, {"server_uuid": "620bc9c9-26a0-461f-8771-418b3e9aea79", "name": "network-vif-plugged", "status": "completed", "tag": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf"}, {"server_uuid": "620bc9c9-26a0-461f-8771-418b3e9aea79", "name": "network-vif-plugged", "status": "completed", "tag": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf"}, {"server_uuid": "620bc9c9-26a0-461f-8771-418b3e9aea79", "name": "network-vif-unplugged", "status": "completed", "tag": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf"}, {"server_uuid": "620bc9c9-26a0-461f-8771-418b3e9aea79", "name": "network-vif-plugged", "status": "completed", "tag": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:20:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Creating event network-vif-plugged:96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance 620bc9c9-26a0-461f-8771-418b3e9aea79 on user Apr 13 19:20:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Creating event network-vif-plugged:96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance 620bc9c9-26a0-461f-8771-418b3e9aea79 on user Apr 13 19:20:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Creating event network-vif-plugged:96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance 620bc9c9-26a0-461f-8771-418b3e9aea79 on user Apr 13 19:20:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Creating event network-vif-unplugged:96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance 620bc9c9-26a0-461f-8771-418b3e9aea79 on user Apr 13 19:20:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Creating event network-vif-plugged:96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance 620bc9c9-26a0-461f-8771-418b3e9aea79 on user Apr 13 19:20:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.030109 Apr 13 19:20:22 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 285/858] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:20:21 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:20:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-95d77bb6-bd17-47cb-a089-26e81768322f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:28 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-95d77bb6-bd17-47cb-a089-26e81768322f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-95d77bb6-bd17-47cb-a089-26e81768322f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-95d77bb6-bd17-47cb-a089-26e81768322f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-95d77bb6-bd17-47cb-a089-26e81768322f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-95d77bb6-bd17-47cb-a089-26e81768322f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-95d77bb6-bd17-47cb-a089-26e81768322f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-95d77bb6-bd17-47cb-a089-26e81768322f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-95d77bb6-bd17-47cb-a089-26e81768322f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HTTP exception thrown: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-95d77bb6-bd17-47cb-a089-26e81768322f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Request method failure captured: Apr 13 19:20:28 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 HTTP/1.1 Apr 13 19:20:28 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:20:28 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:20:28 user devstack@n-api.service[61587]: Connection: close Apr 13 19:20:28 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:20:28 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:20:28 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:20:28 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:20:28 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBlNOWHCTMQFhEy-J7a2c-bBW9BYSiLEOuq4QoVDDv1EVfFMjZ25Ph853NFwBdH11xS3Mqv7Dy9ybmURzfKRfyWi697O6pLOyn5O9BBYr739mk-f3LssIPTYGf8Vavom6lNQh3pv5dsPZEl9SILs5NibB7-FcDC1lhHGpeko0c1qsI Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Project-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Project-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}] Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Tenant: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Tenant-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:20:28 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:20:28 user devstack@n-api.service[61587]: X-User: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:20:28 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:20:28 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:20:28 user devstack@n-api.service[61587]: X-User-Id: df209814208d415e9d414d39205aaad6 Apr 13 19:20:28 user devstack@n-api.service[61587]: X-User-Name: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:20:28 user devstack@n-api.service[61587]: method: > Apr 13 19:20:28 user devstack@n-api.service[61587]: exception: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:28 user devstack@n-api.service[61587]: action_args: {'id': 'a9f3d080-a163-4897-9187-2687cae49694'} Apr 13 19:20:28 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:28 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:20:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-95d77bb6-bd17-47cb-a089-26e81768322f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Returning 404 to user: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:20:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-95d77bb6-bd17-47cb-a089-26e81768322f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 404 len: 111 microversion: 2.1 time: 0.028766 Apr 13 19:20:28 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 289/859] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:20:28 2023] GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:20:28 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-dff24098-a6ee-4d55-8bc2-afdbebf655e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:28 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-dff24098-a6ee-4d55-8bc2-afdbebf655e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dff24098-a6ee-4d55-8bc2-afdbebf655e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dff24098-a6ee-4d55-8bc2-afdbebf655e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dff24098-a6ee-4d55-8bc2-afdbebf655e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dff24098-a6ee-4d55-8bc2-afdbebf655e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dff24098-a6ee-4d55-8bc2-afdbebf655e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dff24098-a6ee-4d55-8bc2-afdbebf655e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:28 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-dff24098-a6ee-4d55-8bc2-afdbebf655e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HTTP exception thrown: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:28 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-dff24098-a6ee-4d55-8bc2-afdbebf655e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Request method failure captured: Apr 13 19:20:28 user devstack@n-api.service[61589]: request: DELETE /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 HTTP/1.1 Apr 13 19:20:28 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:20:28 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:20:28 user devstack@n-api.service[61589]: Connection: close Apr 13 19:20:28 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:20:28 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:20:28 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:20:28 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:20:28 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFBlNOWHCTMQFhEy-J7a2c-bBW9BYSiLEOuq4QoVDDv1EVfFMjZ25Ph853NFwBdH11xS3Mqv7Dy9ybmURzfKRfyWi697O6pLOyn5O9BBYr739mk-f3LssIPTYGf8Vavom6lNQh3pv5dsPZEl9SILs5NibB7-FcDC1lhHGpeko0c1qsI Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Project-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Project-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}] Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Tenant: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Tenant-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:20:28 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:20:28 user devstack@n-api.service[61589]: X-User: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:20:28 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:20:28 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:20:28 user devstack@n-api.service[61589]: X-User-Id: df209814208d415e9d414d39205aaad6 Apr 13 19:20:28 user devstack@n-api.service[61589]: X-User-Name: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:20:28 user devstack@n-api.service[61589]: method: > Apr 13 19:20:28 user devstack@n-api.service[61589]: exception: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:28 user devstack@n-api.service[61589]: action_args: {'id': 'a9f3d080-a163-4897-9187-2687cae49694'} Apr 13 19:20:28 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:28 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:20:28 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-dff24098-a6ee-4d55-8bc2-afdbebf655e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Returning 404 to user: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:20:28 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-dff24098-a6ee-4d55-8bc2-afdbebf655e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 404 len: 111 microversion: 2.1 time: 0.029990 Apr 13 19:20:28 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 286/860] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:20:28 2023] DELETE /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:20:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f408d335-2940-492f-9593-aa7a52598b00 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:28 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f408d335-2940-492f-9593-aa7a52598b00 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f408d335-2940-492f-9593-aa7a52598b00 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f408d335-2940-492f-9593-aa7a52598b00 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f408d335-2940-492f-9593-aa7a52598b00 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f408d335-2940-492f-9593-aa7a52598b00 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f408d335-2940-492f-9593-aa7a52598b00 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f408d335-2940-492f-9593-aa7a52598b00 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:29 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-f408d335-2940-492f-9593-aa7a52598b00 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HTTP exception thrown: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:29 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f408d335-2940-492f-9593-aa7a52598b00 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Request method failure captured: Apr 13 19:20:29 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 HTTP/1.1 Apr 13 19:20:29 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:20:29 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:20:29 user devstack@n-api.service[61588]: Connection: close Apr 13 19:20:29 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:20:29 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:20:29 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:20:29 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:20:29 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBlNOWHCTMQFhEy-J7a2c-bBW9BYSiLEOuq4QoVDDv1EVfFMjZ25Ph853NFwBdH11xS3Mqv7Dy9ybmURzfKRfyWi697O6pLOyn5O9BBYr739mk-f3LssIPTYGf8Vavom6lNQh3pv5dsPZEl9SILs5NibB7-FcDC1lhHGpeko0c1qsI Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Project-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Project-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}] Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Tenant: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Tenant-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:20:29 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:20:29 user devstack@n-api.service[61588]: X-User: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:20:29 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:20:29 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:20:29 user devstack@n-api.service[61588]: X-User-Id: df209814208d415e9d414d39205aaad6 Apr 13 19:20:29 user devstack@n-api.service[61588]: X-User-Name: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:20:29 user devstack@n-api.service[61588]: method: > Apr 13 19:20:29 user devstack@n-api.service[61588]: exception: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:29 user devstack@n-api.service[61588]: action_args: {'id': 'a9f3d080-a163-4897-9187-2687cae49694'} Apr 13 19:20:29 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. Apr 13 19:20:29 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:20:29 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f408d335-2940-492f-9593-aa7a52598b00 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Returning 404 to user: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:20:29 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-f408d335-2940-492f-9593-aa7a52598b00 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694" status: 404 len: 111 microversion: 2.1 time: 0.027135 Apr 13 19:20:29 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 286/861] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:20:28 2023] GET /compute/v2.1/servers/a9f3d080-a163-4897-9187-2687cae49694 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:20:29 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:29 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:29 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:20:29 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba" status: 204 len: 0 microversion: 2.1 time: 0.106151 Apr 13 19:20:29 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 290/862] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:20:29 2023] DELETE /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:20:29 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-0680f54d-18e4-4cf3-9678-4317d1f71f2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:29 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-0680f54d-18e4-4cf3-9678-4317d1f71f2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0680f54d-18e4-4cf3-9678-4317d1f71f2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0680f54d-18e4-4cf3-9678-4317d1f71f2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0680f54d-18e4-4cf3-9678-4317d1f71f2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0680f54d-18e4-4cf3-9678-4317d1f71f2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0680f54d-18e4-4cf3-9678-4317d1f71f2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-0680f54d-18e4-4cf3-9678-4317d1f71f2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:29 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-0680f54d-18e4-4cf3-9678-4317d1f71f2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:20:29 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-0680f54d-18e4-4cf3-9678-4317d1f71f2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba" status: 200 len: 1543 microversion: 2.1 time: 0.165320 Apr 13 19:20:29 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 287/863] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:20:29 2023] GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba => generated 1543 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:20:29 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-4fb4b474-8baa-4a44-9333-721ec0297b1b req-461db05b-7cce-451a-bc55-421580f45deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579c83e7-7976-47f4-9f25-a194e39966ba", "name": "network-vif-unplugged", "status": "completed", "tag": "ab959649-556a-479c-9e13-ec36fb9ebb66"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:20:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-4fb4b474-8baa-4a44-9333-721ec0297b1b req-461db05b-7cce-451a-bc55-421580f45deb service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-4fb4b474-8baa-4a44-9333-721ec0297b1b req-461db05b-7cce-451a-bc55-421580f45deb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:29 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-4fb4b474-8baa-4a44-9333-721ec0297b1b req-461db05b-7cce-451a-bc55-421580f45deb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:29 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-4fb4b474-8baa-4a44-9333-721ec0297b1b req-461db05b-7cce-451a-bc55-421580f45deb service nova] Creating event network-vif-unplugged:ab959649-556a-479c-9e13-ec36fb9ebb66 for instance 579c83e7-7976-47f4-9f25-a194e39966ba on user Apr 13 19:20:29 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-4fb4b474-8baa-4a44-9333-721ec0297b1b req-461db05b-7cce-451a-bc55-421580f45deb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035875 Apr 13 19:20:29 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 287/864] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:20:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:20:30 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-ac74be34-52ea-4132-8b78-fe88835b5fa4 req-5c740abc-15bd-4c72-a6e7-974e6b78601f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579c83e7-7976-47f4-9f25-a194e39966ba", "name": "network-vif-deleted", "tag": "ab959649-556a-479c-9e13-ec36fb9ebb66"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:20:30 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-ac74be34-52ea-4132-8b78-fe88835b5fa4 req-5c740abc-15bd-4c72-a6e7-974e6b78601f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:30 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-ac74be34-52ea-4132-8b78-fe88835b5fa4 req-5c740abc-15bd-4c72-a6e7-974e6b78601f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:30 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-ac74be34-52ea-4132-8b78-fe88835b5fa4 req-5c740abc-15bd-4c72-a6e7-974e6b78601f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:30 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-ac74be34-52ea-4132-8b78-fe88835b5fa4 req-5c740abc-15bd-4c72-a6e7-974e6b78601f service nova] Creating event network-vif-deleted:ab959649-556a-479c-9e13-ec36fb9ebb66 for instance 579c83e7-7976-47f4-9f25-a194e39966ba on user Apr 13 19:20:30 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-ac74be34-52ea-4132-8b78-fe88835b5fa4 req-5c740abc-15bd-4c72-a6e7-974e6b78601f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043273 Apr 13 19:20:30 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 291/865] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:20:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:20:31 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-1758d8a5-9b37-4736-9c6c-470bcb2f85ca req-7cd9bcec-e1b3-4f1f-bdb2-386f9ca32610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579c83e7-7976-47f4-9f25-a194e39966ba", "name": "network-vif-plugged", "status": "completed", "tag": "ab959649-556a-479c-9e13-ec36fb9ebb66"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:20:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1758d8a5-9b37-4736-9c6c-470bcb2f85ca req-7cd9bcec-e1b3-4f1f-bdb2-386f9ca32610 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1758d8a5-9b37-4736-9c6c-470bcb2f85ca req-7cd9bcec-e1b3-4f1f-bdb2-386f9ca32610 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1758d8a5-9b37-4736-9c6c-470bcb2f85ca req-7cd9bcec-e1b3-4f1f-bdb2-386f9ca32610 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:31 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-1758d8a5-9b37-4736-9c6c-470bcb2f85ca req-7cd9bcec-e1b3-4f1f-bdb2-386f9ca32610 service nova] Creating event network-vif-plugged:ab959649-556a-479c-9e13-ec36fb9ebb66 for instance 579c83e7-7976-47f4-9f25-a194e39966ba on user Apr 13 19:20:31 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-1758d8a5-9b37-4736-9c6c-470bcb2f85ca req-7cd9bcec-e1b3-4f1f-bdb2-386f9ca32610 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033818 Apr 13 19:20:31 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 288/866] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:20:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:20:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ee73ed03-97a8-4b35-961f-c00cf1327dc5 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:39 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ee73ed03-97a8-4b35-961f-c00cf1327dc5 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ee73ed03-97a8-4b35-961f-c00cf1327dc5 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ee73ed03-97a8-4b35-961f-c00cf1327dc5 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ee73ed03-97a8-4b35-961f-c00cf1327dc5 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ee73ed03-97a8-4b35-961f-c00cf1327dc5 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ee73ed03-97a8-4b35-961f-c00cf1327dc5 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ee73ed03-97a8-4b35-961f-c00cf1327dc5 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-ee73ed03-97a8-4b35-961f-c00cf1327dc5 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] HTTP exception thrown: Instance 59d7b86a-c723-4255-827e-2f6a641239df could not be found. Apr 13 19:20:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ee73ed03-97a8-4b35-961f-c00cf1327dc5 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Request method failure captured: Apr 13 19:20:39 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df HTTP/1.1 Apr 13 19:20:39 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:20:39 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:20:39 user devstack@n-api.service[61588]: Connection: close Apr 13 19:20:39 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:20:39 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:20:39 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:20:39 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:20:39 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFIW5I_A2oi7_fnWAXup5bR_1v4_NxI2GY1J1uY5nA0Rpx18iBmtG3f0vrXqcApPhKfHUi1pI15fOYoO4JzcqVLkugFjbCLEnhTIfLFsB4wc3App5vw0u0L75IqNFxG2VAhF9UVebRhkjPsHR1_2ogh-T-bEdLq7RR3AuJbhokeecMs Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Project-Id: 42fbd7089a7e4ba8b2597fca0d8e84c8 Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}] Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Tenant-Id: 42fbd7089a7e4ba8b2597fca0d8e84c8 Apr 13 19:20:39 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:20:39 user devstack@n-api.service[61588]: X-User: tempest-ServerRescueNegativeTestJSON-1255770111-project-member Apr 13 19:20:39 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:20:39 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:20:39 user devstack@n-api.service[61588]: X-User-Id: 3bebf61a7401492692f9c60adde178f7 Apr 13 19:20:39 user devstack@n-api.service[61588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255770111-project-member Apr 13 19:20:39 user devstack@n-api.service[61588]: method: > Apr 13 19:20:39 user devstack@n-api.service[61588]: exception: Instance 59d7b86a-c723-4255-827e-2f6a641239df could not be found. Apr 13 19:20:39 user devstack@n-api.service[61588]: action_args: {'id': '59d7b86a-c723-4255-827e-2f6a641239df'} Apr 13 19:20:39 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d7b86a-c723-4255-827e-2f6a641239df could not be found. Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d7b86a-c723-4255-827e-2f6a641239df could not be found. Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d7b86a-c723-4255-827e-2f6a641239df could not be found. Apr 13 19:20:39 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:20:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ee73ed03-97a8-4b35-961f-c00cf1327dc5 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Returning 404 to user: Instance 59d7b86a-c723-4255-827e-2f6a641239df could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:20:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-ee73ed03-97a8-4b35-961f-c00cf1327dc5 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df" status: 404 len: 111 microversion: 2.1 time: 0.249896 Apr 13 19:20:39 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 288/867] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:20:39 2023] GET /compute/v2.1/servers/59d7b86a-c723-4255-827e-2f6a641239df => generated 111 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:20:39 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:39 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:39 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:20:39 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f" status: 204 len: 0 microversion: 2.1 time: 0.109167 Apr 13 19:20:39 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 292/868] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:20:39 2023] DELETE /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:20:39 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f8a45a49-ae11-42ad-9389-9d6a6059d0b9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:39 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f8a45a49-ae11-42ad-9389-9d6a6059d0b9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f8a45a49-ae11-42ad-9389-9d6a6059d0b9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f8a45a49-ae11-42ad-9389-9d6a6059d0b9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f8a45a49-ae11-42ad-9389-9d6a6059d0b9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f8a45a49-ae11-42ad-9389-9d6a6059d0b9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f8a45a49-ae11-42ad-9389-9d6a6059d0b9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f8a45a49-ae11-42ad-9389-9d6a6059d0b9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:39 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-f8a45a49-ae11-42ad-9389-9d6a6059d0b9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:20:39 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f8a45a49-ae11-42ad-9389-9d6a6059d0b9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f" status: 200 len: 1509 microversion: 2.1 time: 0.202138 Apr 13 19:20:39 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 289/869] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:20:39 2023] GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:20:40 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-cddb34ed-9d96-46bc-ac11-e539f273d9e5 req-9cb7a491-4525-4f92-abc7-a144662545a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-unplugged", "status": "completed", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:20:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-cddb34ed-9d96-46bc-ac11-e539f273d9e5 req-9cb7a491-4525-4f92-abc7-a144662545a4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-cddb34ed-9d96-46bc-ac11-e539f273d9e5 req-9cb7a491-4525-4f92-abc7-a144662545a4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-cddb34ed-9d96-46bc-ac11-e539f273d9e5 req-9cb7a491-4525-4f92-abc7-a144662545a4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-cddb34ed-9d96-46bc-ac11-e539f273d9e5 req-9cb7a491-4525-4f92-abc7-a144662545a4 service nova] Creating event network-vif-unplugged:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:20:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-cddb34ed-9d96-46bc-ac11-e539f273d9e5 req-9cb7a491-4525-4f92-abc7-a144662545a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037162 Apr 13 19:20:40 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 289/870] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:20:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:20:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-plugged", "status": "completed", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}, {"server_uuid": "29eeca99-f237-49d9-9c7d-5c5b7ff2892f", "name": "network-vif-deleted", "tag": "0e8742b4-c86f-4294-9d67-8756f74a5b81"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:20:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] Creating event network-vif-plugged:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:20:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] Creating event network-vif-deleted:0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f on user Apr 13 19:20:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030996 Apr 13 19:20:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 293/871] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:20:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:20:48 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-13d79f01-d81a-4460-afd2-81ac1cd85287 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:20:48 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-13d79f01-d81a-4460-afd2-81ac1cd85287 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:20:48 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-13d79f01-d81a-4460-afd2-81ac1cd85287 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:48 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-13d79f01-d81a-4460-afd2-81ac1cd85287 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:48 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-13d79f01-d81a-4460-afd2-81ac1cd85287 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:48 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-13d79f01-d81a-4460-afd2-81ac1cd85287 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:20:48 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-13d79f01-d81a-4460-afd2-81ac1cd85287 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:20:48 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-13d79f01-d81a-4460-afd2-81ac1cd85287 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:20:48 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-13d79f01-d81a-4460-afd2-81ac1cd85287 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789fdd98ede74e6783b667178c2689fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024f13d8c179482791ed1545b6b2efd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:20:48 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-13d79f01-d81a-4460-afd2-81ac1cd85287 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8" status: 200 len: 1494 microversion: 2.1 time: 0.136466 Apr 13 19:20:48 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 290/872] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:20:48 2023] GET /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8 => generated 1494 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:21:09 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=12 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:09 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=16 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-29b77ccd-a178-4664-9c0a-1f44d5dcc653 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:21:09 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-29b77ccd-a178-4664-9c0a-1f44d5dcc653 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:21:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-29b77ccd-a178-4664-9c0a-1f44d5dcc653 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-29b77ccd-a178-4664-9c0a-1f44d5dcc653 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-29b77ccd-a178-4664-9c0a-1f44d5dcc653 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-29b77ccd-a178-4664-9c0a-1f44d5dcc653 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-29b77ccd-a178-4664-9c0a-1f44d5dcc653 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:09 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-29b77ccd-a178-4664-9c0a-1f44d5dcc653 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-29b77ccd-a178-4664-9c0a-1f44d5dcc653 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:21:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-29b77ccd-a178-4664-9c0a-1f44d5dcc653 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:21:09 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79 HTTP/1.1 Apr 13 19:21:09 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:21:09 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:21:09 user devstack@n-api.service[61588]: Connection: close Apr 13 19:21:09 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:21:09 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:21:09 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:21:09 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:21:09 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:21:09 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:21:09 user devstack@n-api.service[61588]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:21:09 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:21:09 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:21:09 user devstack@n-api.service[61588]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:21:09 user devstack@n-api.service[61588]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:21:09 user devstack@n-api.service[61588]: method: > Apr 13 19:21:09 user devstack@n-api.service[61588]: exception: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:21:09 user devstack@n-api.service[61588]: action_args: {'id': '620bc9c9-26a0-461f-8771-418b3e9aea79'} Apr 13 19:21:09 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:21:09 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:09 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-29b77ccd-a178-4664-9c0a-1f44d5dcc653 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 404 to user: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:21:09 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-29b77ccd-a178-4664-9c0a-1f44d5dcc653 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79" status: 404 len: 111 microversion: 2.1 time: 0.033919 Apr 13 19:21:09 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 290/873] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:21:09 2023] GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:21:09 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:09 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:10 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-2037c7aa-8dc9-44b1-b84b-e7c355e395bc tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '.version_select at 0x7efe33c8b880>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:21:10 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-2037c7aa-8dc9-44b1-b84b-e7c355e395bc tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-737326002" status: 202 len: 0 microversion: 2.1 time: 0.036713 Apr 13 19:21:10 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 294/874] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 19:21:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-737326002 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:21:10 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-aa1a8c42-fea9-41b5-8986-782507ebe69f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: .version_select at 0x7efe38207130>, body: {"keypair": {"name": "tempest-keypair-1088218711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyAbm8EUX7I3WFkjXDhcrtssdTYxRcV2GP2/3HprEw0XnjvcQ1CZy+BxvGIuVIAWsa+Rr1WjExbjtk5cqwB2WF85y7qrU1xPaGFgdUsE25Bird1Sw4XYS1a3UKKtgXDRQ=="}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:21:10 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:10 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:10 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-aa1a8c42-fea9-41b5-8986-782507ebe69f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:21:10 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-aa1a8c42-fea9-41b5-8986-782507ebe69f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for user 975d5fe9f1e445f0ba1be8fc71e93ecc and project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:21:10 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-aa1a8c42-fea9-41b5-8986-782507ebe69f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079849 Apr 13 19:21:10 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 291/875] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:21:10 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-592910104", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c6740647-dbe4-4a73-ada4-b154eca2af81"}], "security_groups": [{"name": "tempest-securitygroup--1038345845"}], "key_name": "tempest-keypair-1088218711", "user_data": "}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG nova.network.neutron [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] validate_networks() for [('c6740647-dbe4-4a73-ada4-b154eca2af81', None, None, None, None, None)] {{(pid=61588) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image limits 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image pref 0:0:0 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting quotas for user 975d5fe9f1e445f0ba1be8fc71e93ecc and project 0dcc458426af4ea2b4bbcfdf9b4fe041. Resources: {'cores', 'ram', 'instances'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Going to run 1 instances... {{(pid=61588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:21:12 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:21:12 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.544002 Apr 13 19:21:12 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 291/876] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:21:12 2023] POST /compute/v2.1/servers => generated 400 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:21:12 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a2b1ea34-8d3e-442b-8139-b035e36d4028 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:21:12 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-a2b1ea34-8d3e-442b-8139-b035e36d4028 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:21:12 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-a2b1ea34-8d3e-442b-8139-b035e36d4028 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:21:12 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a2b1ea34-8d3e-442b-8139-b035e36d4028 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286" status: 200 len: 1235 microversion: 2.1 time: 0.078920 Apr 13 19:21:12 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 295/877] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:21:12 2023] GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286 => generated 1235 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:21:15 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca38627f-4cf1-4331-b447-7e32134e3286", "tag": "f9b73165-75e2-47ed-a836-d0704aa5788d"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:21:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] Creating event network-changed:f9b73165-75e2-47ed-a836-d0704aa5788d for instance ca38627f-4cf1-4331-b447-7e32134e3286 on user Apr 13 19:21:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041286 Apr 13 19:21:15 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 292/878] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:21:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:21:17 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-93d1186e-741c-4ca3-b6ee-62ddac621bcd req-52dbb27c-7d75-494f-aa89-9e1002c256e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca38627f-4cf1-4331-b447-7e32134e3286", "name": "network-vif-plugged", "status": "completed", "tag": "f9b73165-75e2-47ed-a836-d0704aa5788d"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:21:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-93d1186e-741c-4ca3-b6ee-62ddac621bcd req-52dbb27c-7d75-494f-aa89-9e1002c256e1 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-93d1186e-741c-4ca3-b6ee-62ddac621bcd req-52dbb27c-7d75-494f-aa89-9e1002c256e1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:17 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-93d1186e-741c-4ca3-b6ee-62ddac621bcd req-52dbb27c-7d75-494f-aa89-9e1002c256e1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:17 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-93d1186e-741c-4ca3-b6ee-62ddac621bcd req-52dbb27c-7d75-494f-aa89-9e1002c256e1 service nova] Creating event network-vif-plugged:f9b73165-75e2-47ed-a836-d0704aa5788d for instance ca38627f-4cf1-4331-b447-7e32134e3286 on user Apr 13 19:21:17 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-93d1186e-741c-4ca3-b6ee-62ddac621bcd req-52dbb27c-7d75-494f-aa89-9e1002c256e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032650 Apr 13 19:21:17 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 292/879] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:21:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:21:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-998e83a7-dac0-4fa7-bdbe-5d9df5b42458 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:21:19 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-998e83a7-dac0-4fa7-bdbe-5d9df5b42458 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:21:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-998e83a7-dac0-4fa7-bdbe-5d9df5b42458 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-998e83a7-dac0-4fa7-bdbe-5d9df5b42458 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-998e83a7-dac0-4fa7-bdbe-5d9df5b42458 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-998e83a7-dac0-4fa7-bdbe-5d9df5b42458 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-998e83a7-dac0-4fa7-bdbe-5d9df5b42458 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-998e83a7-dac0-4fa7-bdbe-5d9df5b42458 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-998e83a7-dac0-4fa7-bdbe-5d9df5b42458 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HTTP exception thrown: Instance 579c83e7-7976-47f4-9f25-a194e39966ba could not be found. Apr 13 19:21:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-998e83a7-dac0-4fa7-bdbe-5d9df5b42458 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Request method failure captured: Apr 13 19:21:19 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba HTTP/1.1 Apr 13 19:21:19 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:21:19 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:21:19 user devstack@n-api.service[61587]: Connection: close Apr 13 19:21:19 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:21:19 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:21:19 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:21:19 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:21:19 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBlNOWHCTMQFhEy-J7a2c-bBW9BYSiLEOuq4QoVDDv1EVfFMjZ25Ph853NFwBdH11xS3Mqv7Dy9ybmURzfKRfyWi697O6pLOyn5O9BBYr739mk-f3LssIPTYGf8Vavom6lNQh3pv5dsPZEl9SILs5NibB7-FcDC1lhHGpeko0c1qsI Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Project-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Project-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}] Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Tenant: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Tenant-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:21:19 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:21:19 user devstack@n-api.service[61587]: X-User: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:21:19 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:21:19 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:21:19 user devstack@n-api.service[61587]: X-User-Id: df209814208d415e9d414d39205aaad6 Apr 13 19:21:19 user devstack@n-api.service[61587]: X-User-Name: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:21:19 user devstack@n-api.service[61587]: method: > Apr 13 19:21:19 user devstack@n-api.service[61587]: exception: Instance 579c83e7-7976-47f4-9f25-a194e39966ba could not be found. Apr 13 19:21:19 user devstack@n-api.service[61587]: action_args: {'id': '579c83e7-7976-47f4-9f25-a194e39966ba'} Apr 13 19:21:19 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579c83e7-7976-47f4-9f25-a194e39966ba could not be found. Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579c83e7-7976-47f4-9f25-a194e39966ba could not be found. Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579c83e7-7976-47f4-9f25-a194e39966ba could not be found. Apr 13 19:21:19 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:21:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-998e83a7-dac0-4fa7-bdbe-5d9df5b42458 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Returning 404 to user: Instance 579c83e7-7976-47f4-9f25-a194e39966ba could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:21:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-998e83a7-dac0-4fa7-bdbe-5d9df5b42458 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba" status: 404 len: 111 microversion: 2.1 time: 0.029966 Apr 13 19:21:19 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 296/880] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:21:19 2023] GET /compute/v2.1/servers/579c83e7-7976-47f4-9f25-a194e39966ba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:21:19 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-3bac2b2b-4bfb-4b3f-8925-55ea16955792 req-9f79f7ee-bfe3-4153-8b1f-49bec95b56ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca38627f-4cf1-4331-b447-7e32134e3286", "name": "network-vif-plugged", "status": "completed", "tag": "f9b73165-75e2-47ed-a836-d0704aa5788d"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:21:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-3bac2b2b-4bfb-4b3f-8925-55ea16955792 req-9f79f7ee-bfe3-4153-8b1f-49bec95b56ac service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-3bac2b2b-4bfb-4b3f-8925-55ea16955792 req-9f79f7ee-bfe3-4153-8b1f-49bec95b56ac service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-3bac2b2b-4bfb-4b3f-8925-55ea16955792 req-9f79f7ee-bfe3-4153-8b1f-49bec95b56ac service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-3bac2b2b-4bfb-4b3f-8925-55ea16955792 req-9f79f7ee-bfe3-4153-8b1f-49bec95b56ac service nova] Creating event network-vif-plugged:f9b73165-75e2-47ed-a836-d0704aa5788d for instance ca38627f-4cf1-4331-b447-7e32134e3286 on user Apr 13 19:21:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-3bac2b2b-4bfb-4b3f-8925-55ea16955792 req-9f79f7ee-bfe3-4153-8b1f-49bec95b56ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037076 Apr 13 19:21:19 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 293/881] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:21:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:21:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4344ec6b-1d05-4589-afae-039890404937 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:21:24 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-4344ec6b-1d05-4589-afae-039890404937 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:21:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4344ec6b-1d05-4589-afae-039890404937 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4344ec6b-1d05-4589-afae-039890404937 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4344ec6b-1d05-4589-afae-039890404937 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4344ec6b-1d05-4589-afae-039890404937 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4344ec6b-1d05-4589-afae-039890404937 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4344ec6b-1d05-4589-afae-039890404937 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-4344ec6b-1d05-4589-afae-039890404937 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HTTP exception thrown: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:21:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4344ec6b-1d05-4589-afae-039890404937 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Request method failure captured: Apr 13 19:21:24 user devstack@n-api.service[61588]: request: DELETE /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 HTTP/1.1 Apr 13 19:21:24 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:21:24 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:21:24 user devstack@n-api.service[61588]: Connection: close Apr 13 19:21:24 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:21:24 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:21:24 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:21:24 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:21:24 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFBlNOWHCTMQFhEy-J7a2c-bBW9BYSiLEOuq4QoVDDv1EVfFMjZ25Ph853NFwBdH11xS3Mqv7Dy9ybmURzfKRfyWi697O6pLOyn5O9BBYr739mk-f3LssIPTYGf8Vavom6lNQh3pv5dsPZEl9SILs5NibB7-FcDC1lhHGpeko0c1qsI Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Project-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Project-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}] Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Tenant: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Tenant-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:21:24 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:21:24 user devstack@n-api.service[61588]: X-User: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:21:24 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:21:24 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:21:24 user devstack@n-api.service[61588]: X-User-Id: df209814208d415e9d414d39205aaad6 Apr 13 19:21:24 user devstack@n-api.service[61588]: X-User-Name: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:21:24 user devstack@n-api.service[61588]: method: > Apr 13 19:21:24 user devstack@n-api.service[61588]: exception: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:21:24 user devstack@n-api.service[61588]: action_args: {'id': 'b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8'} Apr 13 19:21:24 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:21:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4344ec6b-1d05-4589-afae-039890404937 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Returning 404 to user: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:21:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-4344ec6b-1d05-4589-afae-039890404937 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 404 len: 111 microversion: 2.1 time: 0.030849 Apr 13 19:21:24 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 293/882] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:21:24 2023] DELETE /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:21:24 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c62f31db-1f74-465f-82d4-35d8a1df3414 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:21:24 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-c62f31db-1f74-465f-82d4-35d8a1df3414 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:21:25 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c62f31db-1f74-465f-82d4-35d8a1df3414 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c62f31db-1f74-465f-82d4-35d8a1df3414 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c62f31db-1f74-465f-82d4-35d8a1df3414 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c62f31db-1f74-465f-82d4-35d8a1df3414 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c62f31db-1f74-465f-82d4-35d8a1df3414 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:25 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c62f31db-1f74-465f-82d4-35d8a1df3414 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-c62f31db-1f74-465f-82d4-35d8a1df3414 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HTTP exception thrown: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:21:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c62f31db-1f74-465f-82d4-35d8a1df3414 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Request method failure captured: Apr 13 19:21:25 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 HTTP/1.1 Apr 13 19:21:25 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:21:25 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:21:25 user devstack@n-api.service[61587]: Connection: close Apr 13 19:21:25 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:21:25 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:21:25 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:21:25 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:21:25 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFBlNOWHCTMQFhEy-J7a2c-bBW9BYSiLEOuq4QoVDDv1EVfFMjZ25Ph853NFwBdH11xS3Mqv7Dy9ybmURzfKRfyWi697O6pLOyn5O9BBYr739mk-f3LssIPTYGf8Vavom6lNQh3pv5dsPZEl9SILs5NibB7-FcDC1lhHGpeko0c1qsI Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Project-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Project-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c162f91cba4b4ecf9de48fbf839da261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c162f91cba4b4ecf9de48fbf839da261"}]}] Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Tenant: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Tenant-Id: c162f91cba4b4ecf9de48fbf839da261 Apr 13 19:21:25 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-ServerActionsTestJSON-1901931474 Apr 13 19:21:25 user devstack@n-api.service[61587]: X-User: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:21:25 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:21:25 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:21:25 user devstack@n-api.service[61587]: X-User-Id: df209814208d415e9d414d39205aaad6 Apr 13 19:21:25 user devstack@n-api.service[61587]: X-User-Name: tempest-ServerActionsTestJSON-1901931474-project-member Apr 13 19:21:25 user devstack@n-api.service[61587]: method: > Apr 13 19:21:25 user devstack@n-api.service[61587]: exception: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:21:25 user devstack@n-api.service[61587]: action_args: {'id': 'b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8'} Apr 13 19:21:25 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. Apr 13 19:21:25 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:21:25 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c62f31db-1f74-465f-82d4-35d8a1df3414 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Returning 404 to user: Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:21:25 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-c62f31db-1f74-465f-82d4-35d8a1df3414 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" status: 404 len: 111 microversion: 2.1 time: 0.035117 Apr 13 19:21:25 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 297/883] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:21:24 2023] GET /compute/v2.1/servers/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:21:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-368bd9e9-8968-45f8-b3b9-0f5008bc28e4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Calling method '.version_select at 0x7efe33d5f370>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:21:25 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-368bd9e9-8968-45f8-b3b9-0f5008bc28e4 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-479347877" status: 202 len: 0 microversion: 2.1 time: 0.027002 Apr 13 19:21:25 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 294/884] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 19:21:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-479347877 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:21:29 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d114f7a4-1e21-4dec-a946-53b3c27056f4 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:21:29 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-d114f7a4-1e21-4dec-a946-53b3c27056f4 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:21:30 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d114f7a4-1e21-4dec-a946-53b3c27056f4 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:30 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d114f7a4-1e21-4dec-a946-53b3c27056f4 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:30 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d114f7a4-1e21-4dec-a946-53b3c27056f4 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:30 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d114f7a4-1e21-4dec-a946-53b3c27056f4 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:30 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d114f7a4-1e21-4dec-a946-53b3c27056f4 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:30 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-d114f7a4-1e21-4dec-a946-53b3c27056f4 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:30 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-d114f7a4-1e21-4dec-a946-53b3c27056f4 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] HTTP exception thrown: Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f could not be found. Apr 13 19:21:30 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d114f7a4-1e21-4dec-a946-53b3c27056f4 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Request method failure captured: Apr 13 19:21:30 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f HTTP/1.1 Apr 13 19:21:30 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:21:30 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:21:30 user devstack@n-api.service[61588]: Connection: close Apr 13 19:21:30 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:21:30 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:21:30 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:21:30 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:21:30 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFIW5I_A2oi7_fnWAXup5bR_1v4_NxI2GY1J1uY5nA0Rpx18iBmtG3f0vrXqcApPhKfHUi1pI15fOYoO4JzcqVLkugFjbCLEnhTIfLFsB4wc3App5vw0u0L75IqNFxG2VAhF9UVebRhkjPsHR1_2ogh-T-bEdLq7RR3AuJbhokeecMs Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Project-Id: 42fbd7089a7e4ba8b2597fca0d8e84c8 Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/42fbd7089a7e4ba8b2597fca0d8e84c8"}]}] Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Tenant-Id: 42fbd7089a7e4ba8b2597fca0d8e84c8 Apr 13 19:21:30 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255770111 Apr 13 19:21:30 user devstack@n-api.service[61588]: X-User: tempest-ServerRescueNegativeTestJSON-1255770111-project-member Apr 13 19:21:30 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:21:30 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:21:30 user devstack@n-api.service[61588]: X-User-Id: 3bebf61a7401492692f9c60adde178f7 Apr 13 19:21:30 user devstack@n-api.service[61588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255770111-project-member Apr 13 19:21:30 user devstack@n-api.service[61588]: method: > Apr 13 19:21:30 user devstack@n-api.service[61588]: exception: Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f could not be found. Apr 13 19:21:30 user devstack@n-api.service[61588]: action_args: {'id': '29eeca99-f237-49d9-9c7d-5c5b7ff2892f'} Apr 13 19:21:30 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f could not be found. Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f could not be found. Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f could not be found. Apr 13 19:21:30 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:21:30 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-d114f7a4-1e21-4dec-a946-53b3c27056f4 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Returning 404 to user: Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:21:30 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-d114f7a4-1e21-4dec-a946-53b3c27056f4 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f" status: 404 len: 111 microversion: 2.1 time: 0.042173 Apr 13 19:21:30 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 294/885] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:21:29 2023] GET /compute/v2.1/servers/29eeca99-f237-49d9-9c7d-5c5b7ff2892f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:21:37 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:37 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:37 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1490322609", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "09341996-8218-4461-9635-d3f9187c1d42"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:21:37 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] validate_networks() for [('09341996-8218-4461-9635-d3f9187c1d42', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting quotas for project c00a7fcd6d3040e8b2db0448eeda93ad. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting quotas for user dd604fa4d17b42b1abea8c2f2405b58d and project c00a7fcd6d3040e8b2db0448eeda93ad. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:21:38 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:21:38 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.651117 Apr 13 19:21:38 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 298/886] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 19:21:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 19:21:38 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:38 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:38 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7f4b19e2-f4a1-48a1-8800-2a65b942fb1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:21:38 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-7f4b19e2-f4a1-48a1-8800-2a65b942fb1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:21:38 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-7f4b19e2-f4a1-48a1-8800-2a65b942fb1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:21:38 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-7f4b19e2-f4a1-48a1-8800-2a65b942fb1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:21:38 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-7f4b19e2-f4a1-48a1-8800-2a65b942fb1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:21:38 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7f4b19e2-f4a1-48a1-8800-2a65b942fb1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" status: 200 len: 1395 microversion: 2.87 time: 0.089522 Apr 13 19:21:38 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 295/887] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:21:38 2023] GET /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 => generated 1395 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:21:40 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96", "tag": "5bd81344-f669-49c6-897f-97510d86e77b"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:21:40 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:40 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=10 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:21:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] Creating event network-changed:5bd81344-f669-49c6-897f-97510d86e77b for instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 on user Apr 13 19:21:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037444 Apr 13 19:21:40 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 295/888] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:21:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-93222fea-396f-4b91-a382-42f0a20a0d9e req-2f7fc714-815a-4c6e-9afc-03adb16b48ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96", "name": "network-vif-plugged", "status": "completed", "tag": "5bd81344-f669-49c6-897f-97510d86e77b"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:21:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-93222fea-396f-4b91-a382-42f0a20a0d9e req-2f7fc714-815a-4c6e-9afc-03adb16b48ff service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-93222fea-396f-4b91-a382-42f0a20a0d9e req-2f7fc714-815a-4c6e-9afc-03adb16b48ff service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-93222fea-396f-4b91-a382-42f0a20a0d9e req-2f7fc714-815a-4c6e-9afc-03adb16b48ff service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-93222fea-396f-4b91-a382-42f0a20a0d9e req-2f7fc714-815a-4c6e-9afc-03adb16b48ff service nova] Creating event network-vif-plugged:5bd81344-f669-49c6-897f-97510d86e77b for instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 on user Apr 13 19:21:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-93222fea-396f-4b91-a382-42f0a20a0d9e req-2f7fc714-815a-4c6e-9afc-03adb16b48ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045839 Apr 13 19:21:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 299/889] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:21:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:21:44 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-2ef1a969-f282-4d5f-872e-45edbbdae28d req-4f9a739a-4e3b-4ddf-ab99-9d2e466c461d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96", "name": "network-vif-plugged", "status": "completed", "tag": "5bd81344-f669-49c6-897f-97510d86e77b"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:21:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-2ef1a969-f282-4d5f-872e-45edbbdae28d req-4f9a739a-4e3b-4ddf-ab99-9d2e466c461d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-2ef1a969-f282-4d5f-872e-45edbbdae28d req-4f9a739a-4e3b-4ddf-ab99-9d2e466c461d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-2ef1a969-f282-4d5f-872e-45edbbdae28d req-4f9a739a-4e3b-4ddf-ab99-9d2e466c461d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:44 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-2ef1a969-f282-4d5f-872e-45edbbdae28d req-4f9a739a-4e3b-4ddf-ab99-9d2e466c461d service nova] Creating event network-vif-plugged:5bd81344-f669-49c6-897f-97510d86e77b for instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 on user Apr 13 19:21:44 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-2ef1a969-f282-4d5f-872e-45edbbdae28d req-4f9a739a-4e3b-4ddf-ab99-9d2e466c461d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052704 Apr 13 19:21:44 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 296/890] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:21:48 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "303df430-ed5e-409c-8be1-44341b1dbc4e", "device": "/dev/vdb"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:21:48 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:21:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:21:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:21:48 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:21:49 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.641367 Apr 13 19:21:49 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 296/891] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:21:48 2023] POST /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:22:02 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:02 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:02 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:02 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:03 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c35b6460-c7cd-4014-a547-9cff10b8129b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:22:03 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-c35b6460-c7cd-4014-a547-9cff10b8129b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:22:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c35b6460-c7cd-4014-a547-9cff10b8129b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c35b6460-c7cd-4014-a547-9cff10b8129b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c35b6460-c7cd-4014-a547-9cff10b8129b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c35b6460-c7cd-4014-a547-9cff10b8129b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c35b6460-c7cd-4014-a547-9cff10b8129b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c35b6460-c7cd-4014-a547-9cff10b8129b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:03 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-c35b6460-c7cd-4014-a547-9cff10b8129b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:22:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-c35b6460-c7cd-4014-a547-9cff10b8129b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286" status: 200 len: 1546 microversion: 2.1 time: 0.401139 Apr 13 19:22:03 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 300/892] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:22:02 2023] GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286 => generated 1546 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:22:04 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-70568586", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "c7223586-49d3-4185-803e-366173785797", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "824b1924-526b-40ac-95d3-6927aa9656c4"}]}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:22:04 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:04 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=8 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:04 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:04 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] validate_networks() for [('824b1924-526b-40ac-95d3-6927aa9656c4', None, None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for project a5231d999e51417ebe91927707bfd2bd. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for user 526d9c809b81418d89da662f973a1bdc and project a5231d999e51417ebe91927707bfd2bd. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:22:05 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c7223586-49d3-4185-803e-366173785797',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:22:05 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.803751 Apr 13 19:22:05 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 297/893] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:22:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:22:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4479dbb4-203c-47ea-af89-b43b639b8ffc tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:22:05 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-4479dbb4-203c-47ea-af89-b43b639b8ffc tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:22:05 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:05 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:05 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-4479dbb4-203c-47ea-af89-b43b639b8ffc tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:22:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-4479dbb4-203c-47ea-af89-b43b639b8ffc tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27" status: 200 len: 1050 microversion: 2.1 time: 0.076935 Apr 13 19:22:05 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 297/894] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:22:05 2023] GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27 => generated 1050 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:22:07 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bf1375-d15b-4cad-89a3-40ecc0481e27", "tag": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:22:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:07 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] Creating event network-changed:8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b for instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 on user Apr 13 19:22:07 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038964 Apr 13 19:22:07 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 301/895] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:22:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:22:10 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:22:10 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:22:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:10 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:11 user devstack@n-api.service[61589]: DEBUG nova.objects.instance [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'services' on Instance uuid 3b98531d-34ae-4f83-930a-3c970727fac8 {{(pid=61589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:22:11 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8/os-volume_attachments/303df430-ed5e-409c-8be1-44341b1dbc4e" status: 202 len: 0 microversion: 2.1 time: 0.188218 Apr 13 19:22:11 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 298/896] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:22:10 2023] DELETE /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8/os-volume_attachments/303df430-ed5e-409c-8be1-44341b1dbc4e => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:22:11 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:22:11 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:22:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:11 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:11 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:22:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8" status: 204 len: 0 microversion: 2.1 time: 0.120411 Apr 13 19:22:11 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 298/897] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:22:11 2023] DELETE /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:22:11 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-71c52284-aca7-4fe9-a962-089a2ccf7bb3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:22:11 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-71c52284-aca7-4fe9-a962-089a2ccf7bb3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:22:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-71c52284-aca7-4fe9-a962-089a2ccf7bb3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-71c52284-aca7-4fe9-a962-089a2ccf7bb3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-71c52284-aca7-4fe9-a962-089a2ccf7bb3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-71c52284-aca7-4fe9-a962-089a2ccf7bb3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-71c52284-aca7-4fe9-a962-089a2ccf7bb3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-71c52284-aca7-4fe9-a962-089a2ccf7bb3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:11 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-71c52284-aca7-4fe9-a962-089a2ccf7bb3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789fdd98ede74e6783b667178c2689fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024f13d8c179482791ed1545b6b2efd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:22:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-71c52284-aca7-4fe9-a962-089a2ccf7bb3 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8" status: 200 len: 1546 microversion: 2.1 time: 0.179070 Apr 13 19:22:11 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 302/898] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:22:11 2023] GET /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8 => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:22:13 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-78ad6d7f-e151-4a79-962d-9019c2e0d1e5 req-4b380eaa-e558-49fd-94b7-3d8e680bf35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b98531d-34ae-4f83-930a-3c970727fac8", "name": "network-vif-unplugged", "status": "completed", "tag": "83ef4caf-d717-4e45-9511-cfcc225f7b05"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:22:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-78ad6d7f-e151-4a79-962d-9019c2e0d1e5 req-4b380eaa-e558-49fd-94b7-3d8e680bf35d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-78ad6d7f-e151-4a79-962d-9019c2e0d1e5 req-4b380eaa-e558-49fd-94b7-3d8e680bf35d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-78ad6d7f-e151-4a79-962d-9019c2e0d1e5 req-4b380eaa-e558-49fd-94b7-3d8e680bf35d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:13 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-78ad6d7f-e151-4a79-962d-9019c2e0d1e5 req-4b380eaa-e558-49fd-94b7-3d8e680bf35d service nova] Creating event network-vif-unplugged:83ef4caf-d717-4e45-9511-cfcc225f7b05 for instance 3b98531d-34ae-4f83-930a-3c970727fac8 on user Apr 13 19:22:13 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-78ad6d7f-e151-4a79-962d-9019c2e0d1e5 req-4b380eaa-e558-49fd-94b7-3d8e680bf35d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038192 Apr 13 19:22:13 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 299/899] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:22:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:22:14 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-32b7c781-dd32-46e4-8f82-ee3de6039699 req-279a534e-a30a-4aa7-b9b3-ddcea20c74ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b98531d-34ae-4f83-930a-3c970727fac8", "name": "network-vif-deleted", "tag": "83ef4caf-d717-4e45-9511-cfcc225f7b05"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:22:14 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-32b7c781-dd32-46e4-8f82-ee3de6039699 req-279a534e-a30a-4aa7-b9b3-ddcea20c74ad service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:14 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-32b7c781-dd32-46e4-8f82-ee3de6039699 req-279a534e-a30a-4aa7-b9b3-ddcea20c74ad service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:14 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-32b7c781-dd32-46e4-8f82-ee3de6039699 req-279a534e-a30a-4aa7-b9b3-ddcea20c74ad service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-32b7c781-dd32-46e4-8f82-ee3de6039699 req-279a534e-a30a-4aa7-b9b3-ddcea20c74ad service nova] Creating event network-vif-deleted:83ef4caf-d717-4e45-9511-cfcc225f7b05 for instance 3b98531d-34ae-4f83-930a-3c970727fac8 on user Apr 13 19:22:14 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-32b7c781-dd32-46e4-8f82-ee3de6039699 req-279a534e-a30a-4aa7-b9b3-ddcea20c74ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031202 Apr 13 19:22:14 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 299/900] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:22:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:22:15 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-b6fd41e0-d0f9-45db-a2c9-a9ac504c1560 req-daeb7906-3201-4aff-b4d7-070d27bb9c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b98531d-34ae-4f83-930a-3c970727fac8", "name": "network-vif-plugged", "status": "completed", "tag": "83ef4caf-d717-4e45-9511-cfcc225f7b05"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:22:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-b6fd41e0-d0f9-45db-a2c9-a9ac504c1560 req-daeb7906-3201-4aff-b4d7-070d27bb9c6c service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-b6fd41e0-d0f9-45db-a2c9-a9ac504c1560 req-daeb7906-3201-4aff-b4d7-070d27bb9c6c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:15 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-b6fd41e0-d0f9-45db-a2c9-a9ac504c1560 req-daeb7906-3201-4aff-b4d7-070d27bb9c6c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-b6fd41e0-d0f9-45db-a2c9-a9ac504c1560 req-daeb7906-3201-4aff-b4d7-070d27bb9c6c service nova] Creating event network-vif-plugged:83ef4caf-d717-4e45-9511-cfcc225f7b05 for instance 3b98531d-34ae-4f83-930a-3c970727fac8 on user Apr 13 19:22:15 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-b6fd41e0-d0f9-45db-a2c9-a9ac504c1560 req-daeb7906-3201-4aff-b4d7-070d27bb9c6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035368 Apr 13 19:22:15 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 303/901] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:22:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:22:19 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:19 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:19 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-ab8d1dcb-c710-4075-a011-1d110e828e28 req-36e0da4b-da25-473f-882a-8f3ec13b0a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bf1375-d15b-4cad-89a3-40ecc0481e27", "name": "network-vif-plugged", "status": "completed", "tag": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:22:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ab8d1dcb-c710-4075-a011-1d110e828e28 req-36e0da4b-da25-473f-882a-8f3ec13b0a65 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ab8d1dcb-c710-4075-a011-1d110e828e28 req-36e0da4b-da25-473f-882a-8f3ec13b0a65 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-ab8d1dcb-c710-4075-a011-1d110e828e28 req-36e0da4b-da25-473f-882a-8f3ec13b0a65 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-ab8d1dcb-c710-4075-a011-1d110e828e28 req-36e0da4b-da25-473f-882a-8f3ec13b0a65 service nova] Creating event network-vif-plugged:8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b for instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 on user Apr 13 19:22:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-ab8d1dcb-c710-4075-a011-1d110e828e28 req-36e0da4b-da25-473f-882a-8f3ec13b0a65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054166 Apr 13 19:22:19 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 300/902] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:22:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:22:22 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:22 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-8b463977-3764-4009-bdb9-4f06bce890fa req-aa55906a-cec8-44d6-8a15-9c058f32a46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bf1375-d15b-4cad-89a3-40ecc0481e27", "name": "network-vif-plugged", "status": "completed", "tag": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:22:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-8b463977-3764-4009-bdb9-4f06bce890fa req-aa55906a-cec8-44d6-8a15-9c058f32a46b service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-8b463977-3764-4009-bdb9-4f06bce890fa req-aa55906a-cec8-44d6-8a15-9c058f32a46b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-8b463977-3764-4009-bdb9-4f06bce890fa req-aa55906a-cec8-44d6-8a15-9c058f32a46b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-8b463977-3764-4009-bdb9-4f06bce890fa req-aa55906a-cec8-44d6-8a15-9c058f32a46b service nova] Creating event network-vif-plugged:8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b for instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 on user Apr 13 19:22:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-8b463977-3764-4009-bdb9-4f06bce890fa req-aa55906a-cec8-44d6-8a15-9c058f32a46b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040947 Apr 13 19:22:22 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 300/903] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:22:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-14c6455f-5be5-4cca-bb66-9d0292ffb06e tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-14c6455f-5be5-4cca-bb66-9d0292ffb06e tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=8 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=16 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14c6455f-5be5-4cca-bb66-9d0292ffb06e tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14c6455f-5be5-4cca-bb66-9d0292ffb06e tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14c6455f-5be5-4cca-bb66-9d0292ffb06e tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14c6455f-5be5-4cca-bb66-9d0292ffb06e tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14c6455f-5be5-4cca-bb66-9d0292ffb06e tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-14c6455f-5be5-4cca-bb66-9d0292ffb06e tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-14c6455f-5be5-4cca-bb66-9d0292ffb06e tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-14c6455f-5be5-4cca-bb66-9d0292ffb06e tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:22:28 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-14c6455f-5be5-4cca-bb66-9d0292ffb06e tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:22:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-14c6455f-5be5-4cca-bb66-9d0292ffb06e tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" status: 200 len: 1690 microversion: 2.87 time: 0.202449 Apr 13 19:22:28 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 304/904] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:22:28 2023] GET /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:22:55 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:55 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:22:55 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8732b78f-17b9-4e75-b316-d07097a8aaee tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:22:55 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-8732b78f-17b9-4e75-b316-d07097a8aaee tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:22:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8732b78f-17b9-4e75-b316-d07097a8aaee tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8732b78f-17b9-4e75-b316-d07097a8aaee tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8732b78f-17b9-4e75-b316-d07097a8aaee tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8732b78f-17b9-4e75-b316-d07097a8aaee tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:22:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8732b78f-17b9-4e75-b316-d07097a8aaee tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:22:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8732b78f-17b9-4e75-b316-d07097a8aaee tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:22:55 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-8732b78f-17b9-4e75-b316-d07097a8aaee tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:22:55 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-8732b78f-17b9-4e75-b316-d07097a8aaee tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27" status: 200 len: 1376 microversion: 2.1 time: 0.169636 Apr 13 19:22:55 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 301/905] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:22:55 2023] GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27 => generated 1376 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:23:01 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:01 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a3f3c3ad-0e90-4a3a-8453-49bf2bffd812 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:23:01 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-a3f3c3ad-0e90-4a3a-8453-49bf2bffd812 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:23:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a3f3c3ad-0e90-4a3a-8453-49bf2bffd812 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a3f3c3ad-0e90-4a3a-8453-49bf2bffd812 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a3f3c3ad-0e90-4a3a-8453-49bf2bffd812 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a3f3c3ad-0e90-4a3a-8453-49bf2bffd812 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a3f3c3ad-0e90-4a3a-8453-49bf2bffd812 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a3f3c3ad-0e90-4a3a-8453-49bf2bffd812 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:01 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-a3f3c3ad-0e90-4a3a-8453-49bf2bffd812 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] HTTP exception thrown: Instance 3b98531d-34ae-4f83-930a-3c970727fac8 could not be found. Apr 13 19:23:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a3f3c3ad-0e90-4a3a-8453-49bf2bffd812 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Request method failure captured: Apr 13 19:23:01 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8 HTTP/1.1 Apr 13 19:23:01 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:23:01 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:23:01 user devstack@n-api.service[61588]: Connection: close Apr 13 19:23:01 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:23:01 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:23:01 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:23:01 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:23:01 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFUVALxAVSj7D_A0cCVR7KCnn8HScFE27Eq7c2IB3ZsjkA6BQG-avT171U1kAk02x-Uw6J-twmhILqFnPw8-C5AGU_t_hq4dqJ_fiyZP5oBeudpKXnmGKHVq5YpJyJ7xZCrypJvPTVl0HHUNcj0bb3G14TdRLXRlLoVZAALjPQl8VVU Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Project-Id: 024f13d8c179482791ed1545b6b2efd8 Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Project-Name: tempest-VolumesSnapshotTestJSON-613917248 Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024f13d8c179482791ed1545b6b2efd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/024f13d8c179482791ed1545b6b2efd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/024f13d8c179482791ed1545b6b2efd8"}]}] Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Tenant: tempest-VolumesSnapshotTestJSON-613917248 Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Tenant-Id: 024f13d8c179482791ed1545b6b2efd8 Apr 13 19:23:01 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-613917248 Apr 13 19:23:01 user devstack@n-api.service[61588]: X-User: tempest-VolumesSnapshotTestJSON-613917248-project-member Apr 13 19:23:01 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:23:01 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:23:01 user devstack@n-api.service[61588]: X-User-Id: 789fdd98ede74e6783b667178c2689fb Apr 13 19:23:01 user devstack@n-api.service[61588]: X-User-Name: tempest-VolumesSnapshotTestJSON-613917248-project-member Apr 13 19:23:01 user devstack@n-api.service[61588]: method: > Apr 13 19:23:01 user devstack@n-api.service[61588]: exception: Instance 3b98531d-34ae-4f83-930a-3c970727fac8 could not be found. Apr 13 19:23:01 user devstack@n-api.service[61588]: action_args: {'id': '3b98531d-34ae-4f83-930a-3c970727fac8'} Apr 13 19:23:01 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b98531d-34ae-4f83-930a-3c970727fac8 could not be found. Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b98531d-34ae-4f83-930a-3c970727fac8 could not be found. Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b98531d-34ae-4f83-930a-3c970727fac8 could not be found. Apr 13 19:23:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:23:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a3f3c3ad-0e90-4a3a-8453-49bf2bffd812 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Returning 404 to user: Instance 3b98531d-34ae-4f83-930a-3c970727fac8 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:23:01 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-a3f3c3ad-0e90-4a3a-8453-49bf2bffd812 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8" status: 404 len: 111 microversion: 2.1 time: 0.042934 Apr 13 19:23:01 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 301/906] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:23:01 2023] GET /compute/v2.1/servers/3b98531d-34ae-4f83-930a-3c970727fac8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:23:03 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-d552e427-e2f3-4283-8ecb-7a93673a8f98 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:23:03 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-d552e427-e2f3-4283-8ecb-7a93673a8f98 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:23:03 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:03 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d552e427-e2f3-4283-8ecb-7a93673a8f98 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d552e427-e2f3-4283-8ecb-7a93673a8f98 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d552e427-e2f3-4283-8ecb-7a93673a8f98 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d552e427-e2f3-4283-8ecb-7a93673a8f98 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d552e427-e2f3-4283-8ecb-7a93673a8f98 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d552e427-e2f3-4283-8ecb-7a93673a8f98 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-d552e427-e2f3-4283-8ecb-7a93673a8f98 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.100795 Apr 13 19:23:03 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 305/907] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 19:23:03 2023] GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286/os-interface => generated 283 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:23:04 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-84ab718a-f47c-4094-b574-7eb20ab096cf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:23:04 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-84ab718a-f47c-4094-b574-7eb20ab096cf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:23:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-84ab718a-f47c-4094-b574-7eb20ab096cf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-84ab718a-f47c-4094-b574-7eb20ab096cf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-84ab718a-f47c-4094-b574-7eb20ab096cf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-84ab718a-f47c-4094-b574-7eb20ab096cf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-84ab718a-f47c-4094-b574-7eb20ab096cf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-84ab718a-f47c-4094-b574-7eb20ab096cf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:04 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca38627f-4cf1-4331-b447-7e32134e3286", "tag": "f9b73165-75e2-47ed-a836-d0704aa5788d"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:23:04 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-84ab718a-f47c-4094-b574-7eb20ab096cf tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286/ips" status: 200 len: 109 microversion: 2.1 time: 0.040664 Apr 13 19:23:04 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 302/908] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 19:23:04 2023] GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286/ips => generated 109 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:23:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:04 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] Creating event network-changed:f9b73165-75e2-47ed-a836-d0704aa5788d for instance ca38627f-4cf1-4331-b447-7e32134e3286 on user Apr 13 19:23:04 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122067 Apr 13 19:23:04 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 302/909] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:23:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:23:06 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8096855-aac7-49c4-834c-a0ec2d99e7a7"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:23:06 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:23:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:06 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289027 Apr 13 19:23:06 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 306/910] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:23:06 2023] POST /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:23:12 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:23:12 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:23:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:12 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:13 user devstack@n-api.service[61588]: DEBUG nova.objects.instance [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'services' on Instance uuid ca38627f-4cf1-4331-b447-7e32134e3286 {{(pid=61588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:23:13 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286/os-volume_attachments/b8096855-aac7-49c4-834c-a0ec2d99e7a7" status: 202 len: 0 microversion: 2.1 time: 0.243584 Apr 13 19:23:13 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 303/911] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:23:12 2023] DELETE /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286/os-volume_attachments/b8096855-aac7-49c4-834c-a0ec2d99e7a7 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:23:13 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-b3876ebe-c58d-4c85-9d14-2280e26d07ff tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:23:13 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-b3876ebe-c58d-4c85-9d14-2280e26d07ff tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:23:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b3876ebe-c58d-4c85-9d14-2280e26d07ff tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b3876ebe-c58d-4c85-9d14-2280e26d07ff tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b3876ebe-c58d-4c85-9d14-2280e26d07ff tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b3876ebe-c58d-4c85-9d14-2280e26d07ff tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b3876ebe-c58d-4c85-9d14-2280e26d07ff tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-b3876ebe-c58d-4c85-9d14-2280e26d07ff tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:13 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-b3876ebe-c58d-4c85-9d14-2280e26d07ff tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052129 Apr 13 19:23:13 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 303/912] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:23:13 2023] GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:23:28 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:28 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-238497042"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:23:28 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:23:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:29 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/action" status: 202 len: 52 microversion: 2.87 time: 0.851628 Apr 13 19:23:29 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 307/913] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 19:23:28 2023] POST /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/action => generated 52 bytes in 854 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-2c6f4e75-87c3-4780-b4b0-9b73c1813938 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-2c6f4e75-87c3-4780-b4b0-9b73c1813938 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-2c6f4e75-87c3-4780-b4b0-9b73c1813938 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-2c6f4e75-87c3-4780-b4b0-9b73c1813938 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-2c6f4e75-87c3-4780-b4b0-9b73c1813938 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-2c6f4e75-87c3-4780-b4b0-9b73c1813938 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-2c6f4e75-87c3-4780-b4b0-9b73c1813938 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-2c6f4e75-87c3-4780-b4b0-9b73c1813938 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-2c6f4e75-87c3-4780-b4b0-9b73c1813938 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-2c6f4e75-87c3-4780-b4b0-9b73c1813938 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:23:35 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-2c6f4e75-87c3-4780-b4b0-9b73c1813938 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:23:35 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-2c6f4e75-87c3-4780-b4b0-9b73c1813938 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" status: 200 len: 1690 microversion: 2.87 time: 0.229030 Apr 13 19:23:35 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 304/914] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:23:35 2023] GET /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 => generated 1690 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:23:55 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7924fda2-faf8-4122-9afb-2854aa116a85 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:23:55 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-7924fda2-faf8-4122-9afb-2854aa116a85 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:23:55 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:55 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=14 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7924fda2-faf8-4122-9afb-2854aa116a85 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7924fda2-faf8-4122-9afb-2854aa116a85 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7924fda2-faf8-4122-9afb-2854aa116a85 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7924fda2-faf8-4122-9afb-2854aa116a85 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7924fda2-faf8-4122-9afb-2854aa116a85 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:55 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7924fda2-faf8-4122-9afb-2854aa116a85 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:55 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-7924fda2-faf8-4122-9afb-2854aa116a85 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:23:55 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7924fda2-faf8-4122-9afb-2854aa116a85 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27" status: 200 len: 1376 microversion: 2.1 time: 0.150007 Apr 13 19:23:55 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 304/915] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:23:55 2023] GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27 => generated 1376 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:23:55 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:55 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:55 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-aa07d3a1-6d75-48d5-a6c6-8504a010f545 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:23:55 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-aa07d3a1-6d75-48d5-a6c6-8504a010f545 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:23:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-aa07d3a1-6d75-48d5-a6c6-8504a010f545 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-aa07d3a1-6d75-48d5-a6c6-8504a010f545 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-aa07d3a1-6d75-48d5-a6c6-8504a010f545 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-aa07d3a1-6d75-48d5-a6c6-8504a010f545 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-aa07d3a1-6d75-48d5-a6c6-8504a010f545 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-aa07d3a1-6d75-48d5-a6c6-8504a010f545 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:56 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-aa07d3a1-6d75-48d5-a6c6-8504a010f545 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:23:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-aa07d3a1-6d75-48d5-a6c6-8504a010f545 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27" status: 200 len: 1376 microversion: 2.1 time: 0.151277 Apr 13 19:23:56 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 308/916] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:23:55 2023] GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27 => generated 1376 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:23:56 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:23:56 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:23:56 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:56 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:23:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:56 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:23:56 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27" status: 204 len: 0 microversion: 2.1 time: 0.120281 Apr 13 19:23:56 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 305/917] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:23:56 2023] DELETE /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:23:56 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7680e168-dbb8-463e-ae60-ac78d05265c9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:23:56 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-7680e168-dbb8-463e-ae60-ac78d05265c9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:23:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7680e168-dbb8-463e-ae60-ac78d05265c9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7680e168-dbb8-463e-ae60-ac78d05265c9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7680e168-dbb8-463e-ae60-ac78d05265c9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7680e168-dbb8-463e-ae60-ac78d05265c9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7680e168-dbb8-463e-ae60-ac78d05265c9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7680e168-dbb8-463e-ae60-ac78d05265c9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:56 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-7680e168-dbb8-463e-ae60-ac78d05265c9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:23:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7680e168-dbb8-463e-ae60-ac78d05265c9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27" status: 200 len: 1382 microversion: 2.1 time: 0.175405 Apr 13 19:23:56 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 305/918] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:23:56 2023] GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27 => generated 1382 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:23:56 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-dc9b089f-b4ae-4e07-b8cf-4c6fe45098ca req-61551d80-f084-4f1a-8f59-d9fd4d588aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bf1375-d15b-4cad-89a3-40ecc0481e27", "name": "network-vif-unplugged", "status": "completed", "tag": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:23:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dc9b089f-b4ae-4e07-b8cf-4c6fe45098ca req-61551d80-f084-4f1a-8f59-d9fd4d588aeb service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dc9b089f-b4ae-4e07-b8cf-4c6fe45098ca req-61551d80-f084-4f1a-8f59-d9fd4d588aeb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dc9b089f-b4ae-4e07-b8cf-4c6fe45098ca req-61551d80-f084-4f1a-8f59-d9fd4d588aeb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-dc9b089f-b4ae-4e07-b8cf-4c6fe45098ca req-61551d80-f084-4f1a-8f59-d9fd4d588aeb service nova] Creating event network-vif-unplugged:8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b for instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 on user Apr 13 19:23:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-dc9b089f-b4ae-4e07-b8cf-4c6fe45098ca req-61551d80-f084-4f1a-8f59-d9fd4d588aeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041980 Apr 13 19:23:56 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 309/919] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:23:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:23:58 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-f3ab85bb-58c5-43e2-b6e3-7ae2f2d44e08 req-ebeda3f8-554c-49ea-b4cb-8cb1009adcc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bf1375-d15b-4cad-89a3-40ecc0481e27", "name": "network-vif-deleted", "tag": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:23:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-f3ab85bb-58c5-43e2-b6e3-7ae2f2d44e08 req-ebeda3f8-554c-49ea-b4cb-8cb1009adcc9 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-f3ab85bb-58c5-43e2-b6e3-7ae2f2d44e08 req-ebeda3f8-554c-49ea-b4cb-8cb1009adcc9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-f3ab85bb-58c5-43e2-b6e3-7ae2f2d44e08 req-ebeda3f8-554c-49ea-b4cb-8cb1009adcc9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:58 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-f3ab85bb-58c5-43e2-b6e3-7ae2f2d44e08 req-ebeda3f8-554c-49ea-b4cb-8cb1009adcc9 service nova] Creating event network-vif-deleted:8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b for instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 on user Apr 13 19:23:58 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-f3ab85bb-58c5-43e2-b6e3-7ae2f2d44e08 req-ebeda3f8-554c-49ea-b4cb-8cb1009adcc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167066 Apr 13 19:23:58 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 306/920] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:23:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:23:58 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-121e31ec-79e9-4217-b8f2-2d7cbf47b7d8 req-51682eb1-233a-4250-bae5-43f4c327548e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bf1375-d15b-4cad-89a3-40ecc0481e27", "name": "network-vif-plugged", "status": "completed", "tag": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:23:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-121e31ec-79e9-4217-b8f2-2d7cbf47b7d8 req-51682eb1-233a-4250-bae5-43f4c327548e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:23:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-121e31ec-79e9-4217-b8f2-2d7cbf47b7d8 req-51682eb1-233a-4250-bae5-43f4c327548e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:23:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-121e31ec-79e9-4217-b8f2-2d7cbf47b7d8 req-51682eb1-233a-4250-bae5-43f4c327548e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:23:58 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-121e31ec-79e9-4217-b8f2-2d7cbf47b7d8 req-51682eb1-233a-4250-bae5-43f4c327548e service nova] Creating event network-vif-plugged:8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b for instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 on user Apr 13 19:23:58 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-121e31ec-79e9-4217-b8f2-2d7cbf47b7d8 req-51682eb1-233a-4250-bae5-43f4c327548e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029727 Apr 13 19:23:58 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 306/921] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:23:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:24:03 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-7c774690-9d9f-4303-be5a-176402d5e0f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:03 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-7c774690-9d9f-4303-be5a-176402d5e0f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7c774690-9d9f-4303-be5a-176402d5e0f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7c774690-9d9f-4303-be5a-176402d5e0f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7c774690-9d9f-4303-be5a-176402d5e0f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7c774690-9d9f-4303-be5a-176402d5e0f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7c774690-9d9f-4303-be5a-176402d5e0f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-7c774690-9d9f-4303-be5a-176402d5e0f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-7c774690-9d9f-4303-be5a-176402d5e0f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048338 Apr 13 19:24:03 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 310/922] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:24:03 2023] GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:24:03 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:03 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:03 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:24:03 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286" status: 204 len: 0 microversion: 2.1 time: 0.119761 Apr 13 19:24:03 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 307/923] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:24:03 2023] DELETE /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:24:03 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-10b19ecf-625a-4d1b-beb5-6338b7f001f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:03 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-10b19ecf-625a-4d1b-beb5-6338b7f001f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-10b19ecf-625a-4d1b-beb5-6338b7f001f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-10b19ecf-625a-4d1b-beb5-6338b7f001f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-10b19ecf-625a-4d1b-beb5-6338b7f001f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-10b19ecf-625a-4d1b-beb5-6338b7f001f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-10b19ecf-625a-4d1b-beb5-6338b7f001f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-10b19ecf-625a-4d1b-beb5-6338b7f001f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:03 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-10b19ecf-625a-4d1b-beb5-6338b7f001f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:24:03 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-10b19ecf-625a-4d1b-beb5-6338b7f001f4 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286" status: 200 len: 1671 microversion: 2.1 time: 0.262655 Apr 13 19:24:03 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 307/924] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:24:03 2023] GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286 => generated 1671 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:24:03 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-06d2d158-573f-44ba-942a-9532ccbcc7e3 req-e6a850e2-be06-46a1-b89d-950fe849e9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca38627f-4cf1-4331-b447-7e32134e3286", "name": "network-vif-unplugged", "status": "completed", "tag": "f9b73165-75e2-47ed-a836-d0704aa5788d"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:24:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-06d2d158-573f-44ba-942a-9532ccbcc7e3 req-e6a850e2-be06-46a1-b89d-950fe849e9d6 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-06d2d158-573f-44ba-942a-9532ccbcc7e3 req-e6a850e2-be06-46a1-b89d-950fe849e9d6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-06d2d158-573f-44ba-942a-9532ccbcc7e3 req-e6a850e2-be06-46a1-b89d-950fe849e9d6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-06d2d158-573f-44ba-942a-9532ccbcc7e3 req-e6a850e2-be06-46a1-b89d-950fe849e9d6 service nova] Creating event network-vif-unplugged:f9b73165-75e2-47ed-a836-d0704aa5788d for instance ca38627f-4cf1-4331-b447-7e32134e3286 on user Apr 13 19:24:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-06d2d158-573f-44ba-942a-9532ccbcc7e3 req-e6a850e2-be06-46a1-b89d-950fe849e9d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029677 Apr 13 19:24:03 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 311/925] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:24:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:24:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca38627f-4cf1-4331-b447-7e32134e3286", "name": "network-vif-plugged", "status": "completed", "tag": "f9b73165-75e2-47ed-a836-d0704aa5788d"}, {"server_uuid": "ca38627f-4cf1-4331-b447-7e32134e3286", "name": "network-vif-deleted", "tag": "f9b73165-75e2-47ed-a836-d0704aa5788d"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:24:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] Creating event network-vif-plugged:f9b73165-75e2-47ed-a836-d0704aa5788d for instance ca38627f-4cf1-4331-b447-7e32134e3286 on user Apr 13 19:24:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] Creating event network-vif-deleted:f9b73165-75e2-47ed-a836-d0704aa5788d for instance ca38627f-4cf1-4331-b447-7e32134e3286 on user Apr 13 19:24:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031463 Apr 13 19:24:05 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 308/926] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:24:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-984612808", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "09341996-8218-4461-9635-d3f9187c1d42"}]}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=8 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=20 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] validate_networks() for [('09341996-8218-4461-9635-d3f9187c1d42', None, None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting quotas for project c00a7fcd6d3040e8b2db0448eeda93ad. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting quotas for user dd604fa4d17b42b1abea8c2f2405b58d and project c00a7fcd6d3040e8b2db0448eeda93ad. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:24:36 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:24:36 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.617694 Apr 13 19:24:36 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 308/927] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 19:24:36 2023] POST /compute/v2.1/servers => generated 378 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 19:24:36 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=8 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:24:36 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=16 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:24:36 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-becbc66f-c45c-4396-9ea2-d21a303096d7 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:36 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-becbc66f-c45c-4396-9ea2-d21a303096d7 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:36 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-becbc66f-c45c-4396-9ea2-d21a303096d7 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:24:36 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-becbc66f-c45c-4396-9ea2-d21a303096d7 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:24:36 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-becbc66f-c45c-4396-9ea2-d21a303096d7 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:24:36 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-becbc66f-c45c-4396-9ea2-d21a303096d7 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a" status: 200 len: 1394 microversion: 2.87 time: 0.125771 Apr 13 19:24:36 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 312/928] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:24:36 2023] GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a => generated 1394 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:24:39 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:24:39 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:24:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:24:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] Creating event network-changed:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:24:39 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036442 Apr 13 19:24:39 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 309/929] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:24:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:24:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8fd50820-e3d4-4cc6-9b83-30a851c59a27 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:46 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-8fd50820-e3d4-4cc6-9b83-30a851c59a27 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8fd50820-e3d4-4cc6-9b83-30a851c59a27 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8fd50820-e3d4-4cc6-9b83-30a851c59a27 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8fd50820-e3d4-4cc6-9b83-30a851c59a27 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8fd50820-e3d4-4cc6-9b83-30a851c59a27 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8fd50820-e3d4-4cc6-9b83-30a851c59a27 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8fd50820-e3d4-4cc6-9b83-30a851c59a27 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:46 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-8fd50820-e3d4-4cc6-9b83-30a851c59a27 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8fd50820-e3d4-4cc6-9b83-30a851c59a27 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:24:46 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27 HTTP/1.1 Apr 13 19:24:46 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:24:46 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:24:46 user devstack@n-api.service[61589]: Connection: close Apr 13 19:24:46 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:24:46 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:24:46 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:24:46 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:24:46 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:24:46 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:24:46 user devstack@n-api.service[61589]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:24:46 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:24:46 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:24:46 user devstack@n-api.service[61589]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:24:46 user devstack@n-api.service[61589]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:24:46 user devstack@n-api.service[61589]: method: > Apr 13 19:24:46 user devstack@n-api.service[61589]: exception: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61589]: action_args: {'id': '27bf1375-d15b-4cad-89a3-40ecc0481e27'} Apr 13 19:24:46 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8fd50820-e3d4-4cc6-9b83-30a851c59a27 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:24:46 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-8fd50820-e3d4-4cc6-9b83-30a851c59a27 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27" status: 404 len: 111 microversion: 2.1 time: 0.042992 Apr 13 19:24:46 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 309/930] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:24:46 2023] GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:24:46 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-d238d297-f6cc-47fc-9617-37156b30b10f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:46 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-d238d297-f6cc-47fc-9617-37156b30b10f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d238d297-f6cc-47fc-9617-37156b30b10f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d238d297-f6cc-47fc-9617-37156b30b10f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d238d297-f6cc-47fc-9617-37156b30b10f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d238d297-f6cc-47fc-9617-37156b30b10f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d238d297-f6cc-47fc-9617-37156b30b10f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d238d297-f6cc-47fc-9617-37156b30b10f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:46 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-d238d297-f6cc-47fc-9617-37156b30b10f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-d238d297-f6cc-47fc-9617-37156b30b10f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:24:46 user devstack@n-api.service[61587]: request: DELETE /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27 HTTP/1.1 Apr 13 19:24:46 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:24:46 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:24:46 user devstack@n-api.service[61587]: Connection: close Apr 13 19:24:46 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:24:46 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:24:46 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:24:46 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:24:46 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:24:46 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:24:46 user devstack@n-api.service[61587]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:24:46 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:24:46 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:24:46 user devstack@n-api.service[61587]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:24:46 user devstack@n-api.service[61587]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:24:46 user devstack@n-api.service[61587]: method: > Apr 13 19:24:46 user devstack@n-api.service[61587]: exception: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61587]: action_args: {'id': '27bf1375-d15b-4cad-89a3-40ecc0481e27'} Apr 13 19:24:46 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-d238d297-f6cc-47fc-9617-37156b30b10f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:24:46 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-d238d297-f6cc-47fc-9617-37156b30b10f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27" status: 404 len: 111 microversion: 2.1 time: 0.035559 Apr 13 19:24:46 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 313/931] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:24:46 2023] DELETE /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:24:46 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ae8c6c0d-677c-44c0-9a34-812d04870e64 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:46 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ae8c6c0d-677c-44c0-9a34-812d04870e64 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ae8c6c0d-677c-44c0-9a34-812d04870e64 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ae8c6c0d-677c-44c0-9a34-812d04870e64 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ae8c6c0d-677c-44c0-9a34-812d04870e64 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ae8c6c0d-677c-44c0-9a34-812d04870e64 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ae8c6c0d-677c-44c0-9a34-812d04870e64 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ae8c6c0d-677c-44c0-9a34-812d04870e64 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:46 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-ae8c6c0d-677c-44c0-9a34-812d04870e64 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ae8c6c0d-677c-44c0-9a34-812d04870e64 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:24:46 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27 HTTP/1.1 Apr 13 19:24:46 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:24:46 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:24:46 user devstack@n-api.service[61588]: Connection: close Apr 13 19:24:46 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:24:46 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:24:46 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:24:46 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:24:46 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:24:46 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:24:46 user devstack@n-api.service[61588]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:24:46 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:24:46 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:24:46 user devstack@n-api.service[61588]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:24:46 user devstack@n-api.service[61588]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:24:46 user devstack@n-api.service[61588]: method: > Apr 13 19:24:46 user devstack@n-api.service[61588]: exception: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61588]: action_args: {'id': '27bf1375-d15b-4cad-89a3-40ecc0481e27'} Apr 13 19:24:46 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. Apr 13 19:24:46 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:46 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ae8c6c0d-677c-44c0-9a34-812d04870e64 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:24:46 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-ae8c6c0d-677c-44c0-9a34-812d04870e64 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27" status: 404 len: 111 microversion: 2.1 time: 0.044101 Apr 13 19:24:46 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 310/932] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:24:46 2023] GET /compute/v2.1/servers/27bf1375-d15b-4cad-89a3-40ecc0481e27 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:24:50 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-08327eea-3966-4033-8b1e-d79493bf7107 req-46e5215f-af6d-4e47-a255-b93ad15f2216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-plugged", "status": "completed", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:24:50 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:24:50 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:24:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-08327eea-3966-4033-8b1e-d79493bf7107 req-46e5215f-af6d-4e47-a255-b93ad15f2216 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-08327eea-3966-4033-8b1e-d79493bf7107 req-46e5215f-af6d-4e47-a255-b93ad15f2216 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-08327eea-3966-4033-8b1e-d79493bf7107 req-46e5215f-af6d-4e47-a255-b93ad15f2216 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:50 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-08327eea-3966-4033-8b1e-d79493bf7107 req-46e5215f-af6d-4e47-a255-b93ad15f2216 service nova] Creating event network-vif-plugged:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:24:50 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-08327eea-3966-4033-8b1e-d79493bf7107 req-46e5215f-af6d-4e47-a255-b93ad15f2216 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061450 Apr 13 19:24:50 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 310/933] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:24:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:24:52 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-9a05061b-930a-45d2-bd25-e3312277df7b req-4c3a0ee4-99cc-46b3-a773-8d5dd4ea1607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-plugged", "status": "completed", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:24:53 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:24:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-9a05061b-930a-45d2-bd25-e3312277df7b req-4c3a0ee4-99cc-46b3-a773-8d5dd4ea1607 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-9a05061b-930a-45d2-bd25-e3312277df7b req-4c3a0ee4-99cc-46b3-a773-8d5dd4ea1607 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-9a05061b-930a-45d2-bd25-e3312277df7b req-4c3a0ee4-99cc-46b3-a773-8d5dd4ea1607 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-9a05061b-930a-45d2-bd25-e3312277df7b req-4c3a0ee4-99cc-46b3-a773-8d5dd4ea1607 service nova] Creating event network-vif-plugged:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:24:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-9a05061b-930a-45d2-bd25-e3312277df7b req-4c3a0ee4-99cc-46b3-a773-8d5dd4ea1607 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038038 Apr 13 19:24:53 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 314/934] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:24:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:24:53 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-057e3397-4f97-4861-b2aa-a5c7094e2102 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:53 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-057e3397-4f97-4861-b2aa-a5c7094e2102 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-057e3397-4f97-4861-b2aa-a5c7094e2102 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-057e3397-4f97-4861-b2aa-a5c7094e2102 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-057e3397-4f97-4861-b2aa-a5c7094e2102 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-057e3397-4f97-4861-b2aa-a5c7094e2102 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-057e3397-4f97-4861-b2aa-a5c7094e2102 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-057e3397-4f97-4861-b2aa-a5c7094e2102 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:53 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-057e3397-4f97-4861-b2aa-a5c7094e2102 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:53 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-057e3397-4f97-4861-b2aa-a5c7094e2102 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:24:53 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286 HTTP/1.1 Apr 13 19:24:53 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:24:53 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:24:53 user devstack@n-api.service[61588]: Connection: close Apr 13 19:24:53 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:24:53 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:24:53 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:24:53 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:24:53 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:53 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:53 user devstack@n-api.service[61588]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:53 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:24:53 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:24:53 user devstack@n-api.service[61588]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:24:53 user devstack@n-api.service[61588]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:53 user devstack@n-api.service[61588]: method: > Apr 13 19:24:53 user devstack@n-api.service[61588]: exception: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:53 user devstack@n-api.service[61588]: action_args: {'id': 'ca38627f-4cf1-4331-b447-7e32134e3286'} Apr 13 19:24:53 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:53 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:53 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-057e3397-4f97-4861-b2aa-a5c7094e2102 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 404 to user: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:24:53 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-057e3397-4f97-4861-b2aa-a5c7094e2102 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286" status: 404 len: 111 microversion: 2.1 time: 0.030619 Apr 13 19:24:53 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 311/935] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:24:53 2023] GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:24:53 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d641859e-4c5a-427a-8e1a-ea67d2585185 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '.version_select at 0x7efe33d5ee60>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d641859e-4c5a-427a-8e1a-ea67d2585185 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088218711" status: 202 len: 0 microversion: 2.1 time: 0.025821 Apr 13 19:24:53 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 311/936] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 19:24:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088218711 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:24:54 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-241646845", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "6002893f-ec8f-478d-89e7-2761f21a1ed5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "824b1924-526b-40ac-95d3-6927aa9656c4"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] validate_networks() for [('824b1924-526b-40ac-95d3-6927aa9656c4', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for project a5231d999e51417ebe91927707bfd2bd. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for user 526d9c809b81418d89da662f973a1bdc and project a5231d999e51417ebe91927707bfd2bd. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:24:55 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6002893f-ec8f-478d-89e7-2761f21a1ed5',volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:24:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.061400 Apr 13 19:24:56 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 315/937] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:24:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:24:56 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0e75873e-7637-4f98-a641-76df9ae91727 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:56 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-0e75873e-7637-4f98-a641-76df9ae91727 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:56 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-0e75873e-7637-4f98-a641-76df9ae91727 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:24:56 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-0e75873e-7637-4f98-a641-76df9ae91727 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772" status: 200 len: 1065 microversion: 2.1 time: 0.062029 Apr 13 19:24:56 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 312/938] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:24:56 2023] GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772 => generated 1065 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:24:56 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-6627e3a1-cbe8-4d23-9b5b-663244b1b897 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:56 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-6627e3a1-cbe8-4d23-9b5b-663244b1b897 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6627e3a1-cbe8-4d23-9b5b-663244b1b897 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6627e3a1-cbe8-4d23-9b5b-663244b1b897 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6627e3a1-cbe8-4d23-9b5b-663244b1b897 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6627e3a1-cbe8-4d23-9b5b-663244b1b897 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6627e3a1-cbe8-4d23-9b5b-663244b1b897 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-6627e3a1-cbe8-4d23-9b5b-663244b1b897 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-6627e3a1-cbe8-4d23-9b5b-663244b1b897 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:56 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-6627e3a1-cbe8-4d23-9b5b-663244b1b897 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:24:56 user devstack@n-api.service[61589]: request: DELETE /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286 HTTP/1.1 Apr 13 19:24:56 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:24:56 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:24:56 user devstack@n-api.service[61589]: Connection: close Apr 13 19:24:56 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:24:56 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:24:56 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:24:56 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:24:56 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:56 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:56 user devstack@n-api.service[61589]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:56 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:24:56 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:24:56 user devstack@n-api.service[61589]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:24:56 user devstack@n-api.service[61589]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:56 user devstack@n-api.service[61589]: method: > Apr 13 19:24:56 user devstack@n-api.service[61589]: exception: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:56 user devstack@n-api.service[61589]: action_args: {'id': 'ca38627f-4cf1-4331-b447-7e32134e3286'} Apr 13 19:24:56 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:56 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:56 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-6627e3a1-cbe8-4d23-9b5b-663244b1b897 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 404 to user: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:24:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-6627e3a1-cbe8-4d23-9b5b-663244b1b897 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286" status: 404 len: 111 microversion: 2.1 time: 0.031985 Apr 13 19:24:56 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 312/939] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:24:56 2023] DELETE /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:24:56 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-23c197ae-f689-47a1-a275-6204650f1b66 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:56 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-23c197ae-f689-47a1-a275-6204650f1b66 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-23c197ae-f689-47a1-a275-6204650f1b66 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-23c197ae-f689-47a1-a275-6204650f1b66 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-23c197ae-f689-47a1-a275-6204650f1b66 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-23c197ae-f689-47a1-a275-6204650f1b66 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-23c197ae-f689-47a1-a275-6204650f1b66 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-23c197ae-f689-47a1-a275-6204650f1b66 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-23c197ae-f689-47a1-a275-6204650f1b66 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:56 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-23c197ae-f689-47a1-a275-6204650f1b66 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:24:56 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286 HTTP/1.1 Apr 13 19:24:56 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:24:56 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:24:56 user devstack@n-api.service[61587]: Connection: close Apr 13 19:24:56 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:24:56 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:24:56 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:24:56 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:24:56 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:56 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:56 user devstack@n-api.service[61587]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:56 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:24:56 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:24:56 user devstack@n-api.service[61587]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:24:56 user devstack@n-api.service[61587]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:56 user devstack@n-api.service[61587]: method: > Apr 13 19:24:56 user devstack@n-api.service[61587]: exception: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:56 user devstack@n-api.service[61587]: action_args: {'id': 'ca38627f-4cf1-4331-b447-7e32134e3286'} Apr 13 19:24:56 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. Apr 13 19:24:56 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:56 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-23c197ae-f689-47a1-a275-6204650f1b66 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 404 to user: Instance ca38627f-4cf1-4331-b447-7e32134e3286 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:24:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-23c197ae-f689-47a1-a275-6204650f1b66 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286" status: 404 len: 111 microversion: 2.1 time: 0.042657 Apr 13 19:24:56 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 316/940] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:24:56 2023] GET /compute/v2.1/servers/ca38627f-4cf1-4331-b447-7e32134e3286 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 19:24:58 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f05f7e3-6b1d-42bb-a567-ebfab8001772", "tag": "d4720014-5ce3-41b2-80e7-02fc430417f3"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:24:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:58 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] Creating event network-changed:d4720014-5ce3-41b2-80e7-02fc430417f3 for instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 on user Apr 13 19:24:58 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030712 Apr 13 19:24:58 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 313/941] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:24:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:24:58 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d4fe4f47-e37e-4c6e-8751-62c8a882f2e8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:58 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-d4fe4f47-e37e-4c6e-8751-62c8a882f2e8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d4fe4f47-e37e-4c6e-8751-62c8a882f2e8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:58 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d4fe4f47-e37e-4c6e-8751-62c8a882f2e8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d4fe4f47-e37e-4c6e-8751-62c8a882f2e8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d4fe4f47-e37e-4c6e-8751-62c8a882f2e8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d4fe4f47-e37e-4c6e-8751-62c8a882f2e8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d4fe4f47-e37e-4c6e-8751-62c8a882f2e8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:59 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-d4fe4f47-e37e-4c6e-8751-62c8a882f2e8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d4fe4f47-e37e-4c6e-8751-62c8a882f2e8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:24:59 user devstack@n-api.service[61589]: request: DELETE /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79 HTTP/1.1 Apr 13 19:24:59 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:24:59 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:24:59 user devstack@n-api.service[61589]: Connection: close Apr 13 19:24:59 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:24:59 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:24:59 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:24:59 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:24:59 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:59 user devstack@n-api.service[61589]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:59 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:24:59 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:24:59 user devstack@n-api.service[61589]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:24:59 user devstack@n-api.service[61589]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:59 user devstack@n-api.service[61589]: method: > Apr 13 19:24:59 user devstack@n-api.service[61589]: exception: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61589]: action_args: {'id': '620bc9c9-26a0-461f-8771-418b3e9aea79'} Apr 13 19:24:59 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d4fe4f47-e37e-4c6e-8751-62c8a882f2e8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 404 to user: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:24:59 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d4fe4f47-e37e-4c6e-8751-62c8a882f2e8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79" status: 404 len: 111 microversion: 2.1 time: 0.048052 Apr 13 19:24:59 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 313/942] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:24:58 2023] DELETE /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:24:59 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-4021e4d7-0147-4954-b1da-99843970777e tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:59 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-4021e4d7-0147-4954-b1da-99843970777e tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4021e4d7-0147-4954-b1da-99843970777e tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4021e4d7-0147-4954-b1da-99843970777e tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4021e4d7-0147-4954-b1da-99843970777e tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4021e4d7-0147-4954-b1da-99843970777e tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4021e4d7-0147-4954-b1da-99843970777e tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4021e4d7-0147-4954-b1da-99843970777e tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-4021e4d7-0147-4954-b1da-99843970777e tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-4021e4d7-0147-4954-b1da-99843970777e tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:24:59 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79 HTTP/1.1 Apr 13 19:24:59 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:24:59 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:24:59 user devstack@n-api.service[61587]: Connection: close Apr 13 19:24:59 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:24:59 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:24:59 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:24:59 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:24:59 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:59 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:59 user devstack@n-api.service[61587]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:59 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:24:59 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:24:59 user devstack@n-api.service[61587]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:24:59 user devstack@n-api.service[61587]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:59 user devstack@n-api.service[61587]: method: > Apr 13 19:24:59 user devstack@n-api.service[61587]: exception: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61587]: action_args: {'id': '620bc9c9-26a0-461f-8771-418b3e9aea79'} Apr 13 19:24:59 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-4021e4d7-0147-4954-b1da-99843970777e tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 404 to user: Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:24:59 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-4021e4d7-0147-4954-b1da-99843970777e tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79" status: 404 len: 111 microversion: 2.1 time: 0.034232 Apr 13 19:24:59 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 317/943] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:24:59 2023] GET /compute/v2.1/servers/620bc9c9-26a0-461f-8771-418b3e9aea79 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:24:59 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ae1fac62-546e-4898-9b4f-fa0a2f30cff8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:59 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ae1fac62-546e-4898-9b4f-fa0a2f30cff8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ae1fac62-546e-4898-9b4f-fa0a2f30cff8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ae1fac62-546e-4898-9b4f-fa0a2f30cff8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ae1fac62-546e-4898-9b4f-fa0a2f30cff8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ae1fac62-546e-4898-9b4f-fa0a2f30cff8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ae1fac62-546e-4898-9b4f-fa0a2f30cff8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ae1fac62-546e-4898-9b4f-fa0a2f30cff8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-ae1fac62-546e-4898-9b4f-fa0a2f30cff8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ae1fac62-546e-4898-9b4f-fa0a2f30cff8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:24:59 user devstack@n-api.service[61588]: request: DELETE /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8 HTTP/1.1 Apr 13 19:24:59 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:24:59 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:24:59 user devstack@n-api.service[61588]: Connection: close Apr 13 19:24:59 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:24:59 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:24:59 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:24:59 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:24:59 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:59 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:59 user devstack@n-api.service[61588]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:59 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:24:59 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:24:59 user devstack@n-api.service[61588]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:24:59 user devstack@n-api.service[61588]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:59 user devstack@n-api.service[61588]: method: > Apr 13 19:24:59 user devstack@n-api.service[61588]: exception: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61588]: action_args: {'id': '1d7439c2-317e-4454-905f-dc8e59bc49e8'} Apr 13 19:24:59 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ae1fac62-546e-4898-9b4f-fa0a2f30cff8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 404 to user: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:24:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-ae1fac62-546e-4898-9b4f-fa0a2f30cff8 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8" status: 404 len: 111 microversion: 2.1 time: 0.029339 Apr 13 19:24:59 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 314/944] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:24:59 2023] DELETE /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ac850848-46dd-4f4c-b1bb-474d72005b37 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-ac850848-46dd-4f4c-b1bb-474d72005b37 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ac850848-46dd-4f4c-b1bb-474d72005b37 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ac850848-46dd-4f4c-b1bb-474d72005b37 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ac850848-46dd-4f4c-b1bb-474d72005b37 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ac850848-46dd-4f4c-b1bb-474d72005b37 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ac850848-46dd-4f4c-b1bb-474d72005b37 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-ac850848-46dd-4f4c-b1bb-474d72005b37 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:24:59 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-ac850848-46dd-4f4c-b1bb-474d72005b37 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ac850848-46dd-4f4c-b1bb-474d72005b37 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:24:59 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8 HTTP/1.1 Apr 13 19:24:59 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:24:59 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:24:59 user devstack@n-api.service[61589]: Connection: close Apr 13 19:24:59 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:24:59 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:24:59 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:24:59 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:24:59 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:24:59 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:24:59 user devstack@n-api.service[61589]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:59 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:24:59 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:24:59 user devstack@n-api.service[61589]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:24:59 user devstack@n-api.service[61589]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:24:59 user devstack@n-api.service[61589]: method: > Apr 13 19:24:59 user devstack@n-api.service[61589]: exception: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61589]: action_args: {'id': '1d7439c2-317e-4454-905f-dc8e59bc49e8'} Apr 13 19:24:59 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. Apr 13 19:24:59 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:24:59 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-ac850848-46dd-4f4c-b1bb-474d72005b37 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 404 to user: Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:24:59 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-ac850848-46dd-4f4c-b1bb-474d72005b37 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8" status: 404 len: 111 microversion: 2.1 time: 0.034286 Apr 13 19:24:59 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 314/945] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:24:59 2023] GET /compute/v2.1/servers/1d7439c2-317e-4454-905f-dc8e59bc49e8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:25:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-4dd86668-1814-437a-9608-321364e69a22 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:25:01 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-4dd86668-1814-437a-9608-321364e69a22 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:25:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4dd86668-1814-437a-9608-321364e69a22 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:25:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4dd86668-1814-437a-9608-321364e69a22 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:25:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4dd86668-1814-437a-9608-321364e69a22 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:25:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4dd86668-1814-437a-9608-321364e69a22 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:25:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4dd86668-1814-437a-9608-321364e69a22 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:25:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4dd86668-1814-437a-9608-321364e69a22 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:25:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-4dd86668-1814-437a-9608-321364e69a22 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:25:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-4dd86668-1814-437a-9608-321364e69a22 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:25:01 user devstack@n-api.service[61587]: request: DELETE /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d HTTP/1.1 Apr 13 19:25:01 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:25:01 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:25:01 user devstack@n-api.service[61587]: Connection: close Apr 13 19:25:01 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:25:01 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:25:01 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:25:01 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:25:01 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:25:01 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:25:01 user devstack@n-api.service[61587]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:25:01 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:25:01 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:25:01 user devstack@n-api.service[61587]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:25:01 user devstack@n-api.service[61587]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:25:01 user devstack@n-api.service[61587]: method: > Apr 13 19:25:01 user devstack@n-api.service[61587]: exception: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:25:01 user devstack@n-api.service[61587]: action_args: {'id': 'ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d'} Apr 13 19:25:01 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:25:01 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:25:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-4dd86668-1814-437a-9608-321364e69a22 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 404 to user: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:25:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-4dd86668-1814-437a-9608-321364e69a22 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" status: 404 len: 111 microversion: 2.1 time: 0.032493 Apr 13 19:25:01 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 318/946] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:25:01 2023] DELETE /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:25:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-bce78ccd-1e0c-4235-a798-3ed0a3b53e54 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:25:01 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-bce78ccd-1e0c-4235-a798-3ed0a3b53e54 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:25:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-bce78ccd-1e0c-4235-a798-3ed0a3b53e54 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:25:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-bce78ccd-1e0c-4235-a798-3ed0a3b53e54 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:25:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-bce78ccd-1e0c-4235-a798-3ed0a3b53e54 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:25:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-bce78ccd-1e0c-4235-a798-3ed0a3b53e54 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:25:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-bce78ccd-1e0c-4235-a798-3ed0a3b53e54 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:25:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-bce78ccd-1e0c-4235-a798-3ed0a3b53e54 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:25:01 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-bce78ccd-1e0c-4235-a798-3ed0a3b53e54 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HTTP exception thrown: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:25:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-bce78ccd-1e0c-4235-a798-3ed0a3b53e54 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Request method failure captured: Apr 13 19:25:01 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d HTTP/1.1 Apr 13 19:25:01 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:25:01 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:25:01 user devstack@n-api.service[61588]: Connection: close Apr 13 19:25:01 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:25:01 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:25:01 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:25:01 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:25:01 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFO_hPaepsqQw2Zj4XBHn5ROrV9oxwWaz5SM-tEx-X0qS8Izyd8-w7a1qZnrHDZqHpZmSesGHPLSCNLXfRitD9LRs2hnQXq4vgNdW4ct9vCswnB53atm0iS_2iQ5mK_dwsRAn0d8n2YXa_1oBzp7qEzxXtPE8n8MXDMHY9y-N46HzNY Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Project-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Project-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcc458426af4ea2b4bbcfdf9b4fe041"}]}] Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Tenant: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Tenant-Id: 0dcc458426af4ea2b4bbcfdf9b4fe041 Apr 13 19:25:01 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-513091417 Apr 13 19:25:01 user devstack@n-api.service[61588]: X-User: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:25:01 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:25:01 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:25:01 user devstack@n-api.service[61588]: X-User-Id: 975d5fe9f1e445f0ba1be8fc71e93ecc Apr 13 19:25:01 user devstack@n-api.service[61588]: X-User-Name: tempest-AttachVolumeNegativeTest-513091417-project-member Apr 13 19:25:01 user devstack@n-api.service[61588]: method: > Apr 13 19:25:01 user devstack@n-api.service[61588]: exception: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:25:01 user devstack@n-api.service[61588]: action_args: {'id': 'ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d'} Apr 13 19:25:01 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. Apr 13 19:25:01 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:25:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-bce78ccd-1e0c-4235-a798-3ed0a3b53e54 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Returning 404 to user: Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:25:01 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-bce78ccd-1e0c-4235-a798-3ed0a3b53e54 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" status: 404 len: 111 microversion: 2.1 time: 0.032049 Apr 13 19:25:01 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 315/947] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:25:01 2023] GET /compute/v2.1/servers/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 19:25:05 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-1fb9b905-6844-4279-970f-5827444fe06e req-15974671-fe78-4088-8698-1958642c4836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f05f7e3-6b1d-42bb-a567-ebfab8001772", "name": "network-vif-plugged", "status": "completed", "tag": "d4720014-5ce3-41b2-80e7-02fc430417f3"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:25:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1fb9b905-6844-4279-970f-5827444fe06e req-15974671-fe78-4088-8698-1958642c4836 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:25:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1fb9b905-6844-4279-970f-5827444fe06e req-15974671-fe78-4088-8698-1958642c4836 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:25:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1fb9b905-6844-4279-970f-5827444fe06e req-15974671-fe78-4088-8698-1958642c4836 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:25:05 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-1fb9b905-6844-4279-970f-5827444fe06e req-15974671-fe78-4088-8698-1958642c4836 service nova] Creating event network-vif-plugged:d4720014-5ce3-41b2-80e7-02fc430417f3 for instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 on user Apr 13 19:25:05 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-1fb9b905-6844-4279-970f-5827444fe06e req-15974671-fe78-4088-8698-1958642c4836 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222338 Apr 13 19:25:05 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 315/948] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:25:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:25:07 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-95afc92a-b746-4f43-a90d-033ba293eb21 req-274f2cb9-92fe-4ada-8312-1763bd3ac7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f05f7e3-6b1d-42bb-a567-ebfab8001772", "name": "network-vif-plugged", "status": "completed", "tag": "d4720014-5ce3-41b2-80e7-02fc430417f3"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:25:07 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:25:07 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:25:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-95afc92a-b746-4f43-a90d-033ba293eb21 req-274f2cb9-92fe-4ada-8312-1763bd3ac7d7 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:25:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-95afc92a-b746-4f43-a90d-033ba293eb21 req-274f2cb9-92fe-4ada-8312-1763bd3ac7d7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:25:07 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-95afc92a-b746-4f43-a90d-033ba293eb21 req-274f2cb9-92fe-4ada-8312-1763bd3ac7d7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:25:07 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=13 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:25:07 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-95afc92a-b746-4f43-a90d-033ba293eb21 req-274f2cb9-92fe-4ada-8312-1763bd3ac7d7 service nova] Creating event network-vif-plugged:d4720014-5ce3-41b2-80e7-02fc430417f3 for instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 on user Apr 13 19:25:07 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-95afc92a-b746-4f43-a90d-033ba293eb21 req-274f2cb9-92fe-4ada-8312-1763bd3ac7d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046320 Apr 13 19:25:07 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 319/949] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:25:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:25:26 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a92aa03b-3ff9-4042-8c43-10d36bd078d2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:25:26 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-a92aa03b-3ff9-4042-8c43-10d36bd078d2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:25:26 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:25:27 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=16 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:25:27 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=12 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:25:27 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a92aa03b-3ff9-4042-8c43-10d36bd078d2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:25:27 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a92aa03b-3ff9-4042-8c43-10d36bd078d2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:25:27 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a92aa03b-3ff9-4042-8c43-10d36bd078d2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:25:27 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a92aa03b-3ff9-4042-8c43-10d36bd078d2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:25:27 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a92aa03b-3ff9-4042-8c43-10d36bd078d2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:25:27 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a92aa03b-3ff9-4042-8c43-10d36bd078d2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:25:27 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-a92aa03b-3ff9-4042-8c43-10d36bd078d2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:25:27 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-a92aa03b-3ff9-4042-8c43-10d36bd078d2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:25:27 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-a92aa03b-3ff9-4042-8c43-10d36bd078d2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:25:27 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-a92aa03b-3ff9-4042-8c43-10d36bd078d2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a" status: 200 len: 1768 microversion: 2.87 time: 0.159343 Apr 13 19:25:27 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 316/950] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:25:26 2023] GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a => generated 1768 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:25:46 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:25:46 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=14 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:25:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e559065f-2ef7-41e1-99f0-e4c0cec85aa3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:25:46 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e559065f-2ef7-41e1-99f0-e4c0cec85aa3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:25:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e559065f-2ef7-41e1-99f0-e4c0cec85aa3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:25:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e559065f-2ef7-41e1-99f0-e4c0cec85aa3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:25:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e559065f-2ef7-41e1-99f0-e4c0cec85aa3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:25:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e559065f-2ef7-41e1-99f0-e4c0cec85aa3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:25:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e559065f-2ef7-41e1-99f0-e4c0cec85aa3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:25:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e559065f-2ef7-41e1-99f0-e4c0cec85aa3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:25:46 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-e559065f-2ef7-41e1-99f0-e4c0cec85aa3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:25:46 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e559065f-2ef7-41e1-99f0-e4c0cec85aa3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772" status: 200 len: 1392 microversion: 2.1 time: 0.155760 Apr 13 19:25:46 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 316/951] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:25:46 2023] GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:26:27 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:26:27 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:26:27 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "bea83bdb-3ec8-4dda-9739-fabd8caa049f"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:27 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:26:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:27 user devstack@n-api.service[61587]: DEBUG nova.objects.instance [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'flavor' on Instance uuid 991871a0-3a4e-4014-b07f-3e8c49eeda5a {{(pid=61587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:26:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a/action" status: 200 len: 29 microversion: 2.87 time: 0.687387 Apr 13 19:26:28 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 320/952] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 19:26:27 2023] POST /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a/action => generated 29 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-8a26e0fc-6059-4550-b2c5-e39702e757d1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-8a26e0fc-6059-4550-b2c5-e39702e757d1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8a26e0fc-6059-4550-b2c5-e39702e757d1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8a26e0fc-6059-4550-b2c5-e39702e757d1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8a26e0fc-6059-4550-b2c5-e39702e757d1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8a26e0fc-6059-4550-b2c5-e39702e757d1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8a26e0fc-6059-4550-b2c5-e39702e757d1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-8a26e0fc-6059-4550-b2c5-e39702e757d1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-8a26e0fc-6059-4550-b2c5-e39702e757d1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-8a26e0fc-6059-4550-b2c5-e39702e757d1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:26:28 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-8a26e0fc-6059-4550-b2c5-e39702e757d1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:26:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-8a26e0fc-6059-4550-b2c5-e39702e757d1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a" status: 200 len: 1774 microversion: 2.87 time: 0.254371 Apr 13 19:26:28 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 317/953] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:26:28 2023] GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a => generated 1774 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:26:29 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:26:29 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:26:29 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-3e721b91-d0d9-4f1b-a455-e307743cfc22 req-4fd315d2-f99f-46d9-9dab-75c8a2620d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-unplugged", "status": "completed", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-3e721b91-d0d9-4f1b-a455-e307743cfc22 req-4fd315d2-f99f-46d9-9dab-75c8a2620d06 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-3e721b91-d0d9-4f1b-a455-e307743cfc22 req-4fd315d2-f99f-46d9-9dab-75c8a2620d06 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-3e721b91-d0d9-4f1b-a455-e307743cfc22 req-4fd315d2-f99f-46d9-9dab-75c8a2620d06 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:29 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-3e721b91-d0d9-4f1b-a455-e307743cfc22 req-4fd315d2-f99f-46d9-9dab-75c8a2620d06 service nova] Creating event network-vif-unplugged:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:26:29 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-3e721b91-d0d9-4f1b-a455-e307743cfc22 req-4fd315d2-f99f-46d9-9dab-75c8a2620d06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037390 Apr 13 19:26:29 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 317/954] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:26:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:26:31 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-639fe186-553c-4843-990f-bc8ed9a4ae9b req-b836b166-5754-45eb-8f03-31cbdecbdab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-plugged", "status": "completed", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:31 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-639fe186-553c-4843-990f-bc8ed9a4ae9b req-b836b166-5754-45eb-8f03-31cbdecbdab2 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:31 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-639fe186-553c-4843-990f-bc8ed9a4ae9b req-b836b166-5754-45eb-8f03-31cbdecbdab2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:31 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-639fe186-553c-4843-990f-bc8ed9a4ae9b req-b836b166-5754-45eb-8f03-31cbdecbdab2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:31 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-639fe186-553c-4843-990f-bc8ed9a4ae9b req-b836b166-5754-45eb-8f03-31cbdecbdab2 service nova] Creating event network-vif-plugged:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:26:31 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-639fe186-553c-4843-990f-bc8ed9a4ae9b req-b836b166-5754-45eb-8f03-31cbdecbdab2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057663 Apr 13 19:26:31 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 321/955] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:26:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:26:34 user devstack@n-api.service[61588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d96600fe-3d50-4a3b-b2cc-05e6067cdb6e] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 19:26:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-f130ea94-9e5a-44b7-a8ca-676c3a10ae66 req-c0c40f76-1e81-431b-a7d6-2cddbe1c6047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-plugged", "status": "completed", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-f130ea94-9e5a-44b7-a8ca-676c3a10ae66 req-c0c40f76-1e81-431b-a7d6-2cddbe1c6047 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-f130ea94-9e5a-44b7-a8ca-676c3a10ae66 req-c0c40f76-1e81-431b-a7d6-2cddbe1c6047 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-f130ea94-9e5a-44b7-a8ca-676c3a10ae66 req-c0c40f76-1e81-431b-a7d6-2cddbe1c6047 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-f130ea94-9e5a-44b7-a8ca-676c3a10ae66 req-c0c40f76-1e81-431b-a7d6-2cddbe1c6047 service nova] Creating event network-vif-plugged:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:26:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-f130ea94-9e5a-44b7-a8ca-676c3a10ae66 req-c0c40f76-1e81-431b-a7d6-2cddbe1c6047 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041435 Apr 13 19:26:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 318/956] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:26:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:26:36 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-43484b3b-2272-4d4c-a197-65cc7dc88ee9 req-92262ca4-fabf-40b3-9b15-2f7e7b2912df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-plugged", "status": "completed", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-43484b3b-2272-4d4c-a197-65cc7dc88ee9 req-92262ca4-fabf-40b3-9b15-2f7e7b2912df service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-43484b3b-2272-4d4c-a197-65cc7dc88ee9 req-92262ca4-fabf-40b3-9b15-2f7e7b2912df service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:36 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-43484b3b-2272-4d4c-a197-65cc7dc88ee9 req-92262ca4-fabf-40b3-9b15-2f7e7b2912df service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:36 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-43484b3b-2272-4d4c-a197-65cc7dc88ee9 req-92262ca4-fabf-40b3-9b15-2f7e7b2912df service nova] Creating event network-vif-plugged:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:26:36 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-43484b3b-2272-4d4c-a197-65cc7dc88ee9 req-92262ca4-fabf-40b3-9b15-2f7e7b2912df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032683 Apr 13 19:26:36 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 318/957] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:26:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:26:46 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-8974d004-4edf-48fd-b2a6-a4115e9dd45e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:26:46 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-8974d004-4edf-48fd-b2a6-a4115e9dd45e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:26:46 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:26:46 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:26:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8974d004-4edf-48fd-b2a6-a4115e9dd45e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8974d004-4edf-48fd-b2a6-a4115e9dd45e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8974d004-4edf-48fd-b2a6-a4115e9dd45e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8974d004-4edf-48fd-b2a6-a4115e9dd45e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8974d004-4edf-48fd-b2a6-a4115e9dd45e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8974d004-4edf-48fd-b2a6-a4115e9dd45e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:46 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-8974d004-4edf-48fd-b2a6-a4115e9dd45e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:26:46 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-8974d004-4edf-48fd-b2a6-a4115e9dd45e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772" status: 200 len: 1392 microversion: 2.1 time: 0.191254 Apr 13 19:26:46 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 322/958] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:26:46 2023] GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772 => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:26:46 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:26:46 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=8 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:26:46 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c7d47e56-d6a2-4048-8a75-ff3bf12b2312 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-620525499"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:46 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-c7d47e56-d6a2-4048-8a75-ff3bf12b2312 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:26:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c7d47e56-d6a2-4048-8a75-ff3bf12b2312 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c7d47e56-d6a2-4048-8a75-ff3bf12b2312 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c7d47e56-d6a2-4048-8a75-ff3bf12b2312 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c7d47e56-d6a2-4048-8a75-ff3bf12b2312 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c7d47e56-d6a2-4048-8a75-ff3bf12b2312 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c7d47e56-d6a2-4048-8a75-ff3bf12b2312 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:46 user devstack@n-api.service[61588]: INFO oslo.messaging._drivers.impl_rabbit [-] [d96600fe-3d50-4a3b-b2cc-05e6067cdb6e] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 35690. Apr 13 19:26:46 user devstack@n-api.service[61588]: INFO nova.compute.api [None req-c7d47e56-d6a2-4048-8a75-ff3bf12b2312 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Attempting to quiesce instance before volume snapshot. Apr 13 19:26:46 user devstack@n-api.service[61588]: INFO nova.compute.api [None req-c7d47e56-d6a2-4048-8a75-ff3bf12b2312 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 13 19:26:46 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-c7d47e56-d6a2-4048-8a75-ff3bf12b2312 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Creating snapshot from volume 6002893f-ec8f-478d-89e7-2761f21a1ed5. {{(pid=61588) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 13 19:26:48 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:26:48 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:26:48 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-610074d1-5fdf-4656-9ca6-4602231324d3 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Action: 'create', calling method: .version_select at 0x7efe33c71000>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-256533708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjiNQrMZkLrv/EsYiTKx9Bso1DHqJYptOtxcSQw4ewhiYzdhDtT3eKqKNXIIMToEcZ9WUG6UoWwxRLW6EfnAJANQV8bUtuFoVgIl7T4cD+d2MiwUmR5kNz16P2NI+rGLA=="}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:48 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-610074d1-5fdf-4656-9ca6-4602231324d3 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting quotas for project ba0e42217cc44413951d6d5a87dbb886. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:26:48 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-610074d1-5fdf-4656-9ca6-4602231324d3 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting quotas for user 9b9ed2da2b4949269c2df77766a1835f and project ba0e42217cc44413951d6d5a87dbb886. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:26:48 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-610074d1-5fdf-4656-9ca6-4602231324d3 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.067099 Apr 13 19:26:48 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 319/959] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:26:48 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:26:48 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-304929672", "imageRef": "dc0ead7b-fade-4a75-ad11-302ad2eb923b", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-256533708", "networks": [{"uuid": "2b40b836-544b-4e28-9672-0a59d4b98271"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:48 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] validate_networks() for [('2b40b836-544b-4e28-9672-0a59d4b98271', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting quotas for project ba0e42217cc44413951d6d5a87dbb886. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting quotas for user 9b9ed2da2b4949269c2df77766a1835f and project ba0e42217cc44413951d6d5a87dbb886. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dc0ead7b-fade-4a75-ad11-302ad2eb923b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:26:49 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.598912 Apr 13 19:26:49 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 323/960] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:26:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:26:49 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-48351de2-a234-4ad5-8fb5-c8e77a4cb3c9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:26:49 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-48351de2-a234-4ad5-8fb5-c8e77a4cb3c9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:26:49 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-48351de2-a234-4ad5-8fb5-c8e77a4cb3c9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:26:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-48351de2-a234-4ad5-8fb5-c8e77a4cb3c9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6" status: 200 len: 1251 microversion: 2.1 time: 0.065588 Apr 13 19:26:49 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 320/961] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:26:49 2023] GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => generated 1251 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:26:49 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-c7d47e56-d6a2-4048-8a75-ff3bf12b2312 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772/action" status: 202 len: 0 microversion: 2.1 time: 3.027515 Apr 13 19:26:49 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 319/962] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:26:46 2023] POST /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772/action => generated 0 bytes in 3029 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-524715520", "imageRef": "a6c0ca1e-e429-492c-9775-cc28706bb32b", "flavorRef": "42", "networks": [{"uuid": "824b1924-526b-40ac-95d3-6927aa9656c4"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:49 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] validate_networks() for [('824b1924-526b-40ac-95d3-6927aa9656c4', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for project a5231d999e51417ebe91927707bfd2bd. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for user 526d9c809b81418d89da662f973a1bdc and project a5231d999e51417ebe91927707bfd2bd. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:26:50 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='52578be7-3781-4634-a9e5-84b77498fc7a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:26:50 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.576305 Apr 13 19:26:50 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 324/963] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:26:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:26:50 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-95189de2-55d9-47db-951f-d708435abf33 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:26:50 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-95189de2-55d9-47db-951f-d708435abf33 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:26:50 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-95189de2-55d9-47db-951f-d708435abf33 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:26:50 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-95189de2-55d9-47db-951f-d708435abf33 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c" status: 200 len: 1223 microversion: 2.1 time: 0.101179 Apr 13 19:26:50 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 321/964] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:26:50 2023] GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:26:51 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:51 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] Creating event network-changed:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:26:51 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034001 Apr 13 19:26:51 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 320/965] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:26:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:26:53 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef84353-ff2d-4835-b160-e801179c0c9c", "tag": "4afa859b-b4dd-4a45-aace-f4ad471db0d6"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:53 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] Creating event network-changed:4afa859b-b4dd-4a45-aace-f4ad471db0d6 for instance 9ef84353-ff2d-4835-b160-e801179c0c9c on user Apr 13 19:26:53 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061292 Apr 13 19:26:53 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 325/966] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:26:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:26:54 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-46b55057-c67b-4ebf-9264-783ad4275307 req-8867f6a8-fa30-428d-9ed3-9861550b5a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "name": "network-vif-plugged", "status": "completed", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-46b55057-c67b-4ebf-9264-783ad4275307 req-8867f6a8-fa30-428d-9ed3-9861550b5a85 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-46b55057-c67b-4ebf-9264-783ad4275307 req-8867f6a8-fa30-428d-9ed3-9861550b5a85 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:54 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-46b55057-c67b-4ebf-9264-783ad4275307 req-8867f6a8-fa30-428d-9ed3-9861550b5a85 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:54 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-46b55057-c67b-4ebf-9264-783ad4275307 req-8867f6a8-fa30-428d-9ed3-9861550b5a85 service nova] Creating event network-vif-plugged:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:26:54 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-46b55057-c67b-4ebf-9264-783ad4275307 req-8867f6a8-fa30-428d-9ed3-9861550b5a85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049170 Apr 13 19:26:54 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 322/967] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:26:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:26:56 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-e9d86c47-e3fd-4ad3-a1cd-0154629176b1 req-ee3bd699-825f-4f88-8b59-b0147b48b159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "name": "network-vif-plugged", "status": "completed", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:26:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e9d86c47-e3fd-4ad3-a1cd-0154629176b1 req-ee3bd699-825f-4f88-8b59-b0147b48b159 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:26:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e9d86c47-e3fd-4ad3-a1cd-0154629176b1 req-ee3bd699-825f-4f88-8b59-b0147b48b159 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:26:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e9d86c47-e3fd-4ad3-a1cd-0154629176b1 req-ee3bd699-825f-4f88-8b59-b0147b48b159 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:26:56 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-e9d86c47-e3fd-4ad3-a1cd-0154629176b1 req-ee3bd699-825f-4f88-8b59-b0147b48b159 service nova] Creating event network-vif-plugged:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:26:56 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-e9d86c47-e3fd-4ad3-a1cd-0154629176b1 req-ee3bd699-825f-4f88-8b59-b0147b48b159 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035858 Apr 13 19:26:56 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 321/968] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:26:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:27:05 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:05 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=12 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:05 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:05 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=12 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:05 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-5b3c082b-bbfc-4461-9c6f-faed4406beff req-e9d9cd8f-4ff4-4b6e-95ad-df2b87e7be86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef84353-ff2d-4835-b160-e801179c0c9c", "name": "network-vif-plugged", "status": "completed", "tag": "4afa859b-b4dd-4a45-aace-f4ad471db0d6"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:27:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5b3c082b-bbfc-4461-9c6f-faed4406beff req-e9d9cd8f-4ff4-4b6e-95ad-df2b87e7be86 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:27:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5b3c082b-bbfc-4461-9c6f-faed4406beff req-e9d9cd8f-4ff4-4b6e-95ad-df2b87e7be86 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:27:05 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5b3c082b-bbfc-4461-9c6f-faed4406beff req-e9d9cd8f-4ff4-4b6e-95ad-df2b87e7be86 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:27:05 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-5b3c082b-bbfc-4461-9c6f-faed4406beff req-e9d9cd8f-4ff4-4b6e-95ad-df2b87e7be86 service nova] Creating event network-vif-plugged:4afa859b-b4dd-4a45-aace-f4ad471db0d6 for instance 9ef84353-ff2d-4835-b160-e801179c0c9c on user Apr 13 19:27:05 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-5b3c082b-bbfc-4461-9c6f-faed4406beff req-e9d9cd8f-4ff4-4b6e-95ad-df2b87e7be86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094402 Apr 13 19:27:05 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 326/969] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:27:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:27:07 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=8 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:07 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:07 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:07 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-7f9c589b-6aa6-41c9-af5a-75cbad49b4b1 req-e4b94b8b-24cc-4929-abc5-67e63aa3c083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef84353-ff2d-4835-b160-e801179c0c9c", "name": "network-vif-plugged", "status": "completed", "tag": "4afa859b-b4dd-4a45-aace-f4ad471db0d6"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:27:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7f9c589b-6aa6-41c9-af5a-75cbad49b4b1 req-e4b94b8b-24cc-4929-abc5-67e63aa3c083 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:27:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7f9c589b-6aa6-41c9-af5a-75cbad49b4b1 req-e4b94b8b-24cc-4929-abc5-67e63aa3c083 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:27:07 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7f9c589b-6aa6-41c9-af5a-75cbad49b4b1 req-e4b94b8b-24cc-4929-abc5-67e63aa3c083 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:27:07 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-7f9c589b-6aa6-41c9-af5a-75cbad49b4b1 req-e4b94b8b-24cc-4929-abc5-67e63aa3c083 service nova] Creating event network-vif-plugged:4afa859b-b4dd-4a45-aace-f4ad471db0d6 for instance 9ef84353-ff2d-4835-b160-e801179c0c9c on user Apr 13 19:27:07 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-7f9c589b-6aa6-41c9-af5a-75cbad49b4b1 req-e4b94b8b-24cc-4929-abc5-67e63aa3c083 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050315 Apr 13 19:27:07 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 323/970] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:27:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-cdc23f14-1485-4e76-a3fb-0138d4095f18 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-cdc23f14-1485-4e76-a3fb-0138d4095f18 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cdc23f14-1485-4e76-a3fb-0138d4095f18 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cdc23f14-1485-4e76-a3fb-0138d4095f18 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cdc23f14-1485-4e76-a3fb-0138d4095f18 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cdc23f14-1485-4e76-a3fb-0138d4095f18 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cdc23f14-1485-4e76-a3fb-0138d4095f18 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-cdc23f14-1485-4e76-a3fb-0138d4095f18 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-cdc23f14-1485-4e76-a3fb-0138d4095f18 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-cdc23f14-1485-4e76-a3fb-0138d4095f18 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:27:18 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-cdc23f14-1485-4e76-a3fb-0138d4095f18 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:27:18 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-cdc23f14-1485-4e76-a3fb-0138d4095f18 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a" status: 200 len: 1754 microversion: 2.87 time: 0.325729 Apr 13 19:27:18 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 322/971] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:27:18 2023] GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a => generated 1754 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:27:39 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:39 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:39 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3382974e-0b30-421b-a22a-17405de4d95e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:27:39 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-3382974e-0b30-421b-a22a-17405de4d95e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:27:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3382974e-0b30-421b-a22a-17405de4d95e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:27:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3382974e-0b30-421b-a22a-17405de4d95e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:27:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3382974e-0b30-421b-a22a-17405de4d95e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:27:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3382974e-0b30-421b-a22a-17405de4d95e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:27:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3382974e-0b30-421b-a22a-17405de4d95e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:27:39 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3382974e-0b30-421b-a22a-17405de4d95e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:27:39 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-3382974e-0b30-421b-a22a-17405de4d95e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:27:39 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-3382974e-0b30-421b-a22a-17405de4d95e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6" status: 200 len: 1535 microversion: 2.1 time: 0.279557 Apr 13 19:27:39 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 327/972] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:27:39 2023] GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => generated 1535 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:27:40 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:40 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:27:40 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-eebc52bf-7ced-4030-ad44-2b0ec81b9e3e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:27:40 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-eebc52bf-7ced-4030-ad44-2b0ec81b9e3e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:27:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-eebc52bf-7ced-4030-ad44-2b0ec81b9e3e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:27:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-eebc52bf-7ced-4030-ad44-2b0ec81b9e3e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:27:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-eebc52bf-7ced-4030-ad44-2b0ec81b9e3e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:27:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-eebc52bf-7ced-4030-ad44-2b0ec81b9e3e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:27:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-eebc52bf-7ced-4030-ad44-2b0ec81b9e3e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:27:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-eebc52bf-7ced-4030-ad44-2b0ec81b9e3e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:27:40 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-eebc52bf-7ced-4030-ad44-2b0ec81b9e3e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:27:40 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-eebc52bf-7ced-4030-ad44-2b0ec81b9e3e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c" status: 200 len: 1549 microversion: 2.1 time: 0.200050 Apr 13 19:27:40 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 324/973] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:27:40 2023] GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c => generated 1549 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:28:18 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:18 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:18 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:28:18 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:19 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a/action" status: 202 len: 0 microversion: 2.87 time: 0.079328 Apr 13 19:28:19 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 323/974] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 19:28:18 2023] POST /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3c8baf23-b28c-4711-8fc0-9370d1901c01 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-3c8baf23-b28c-4711-8fc0-9370d1901c01 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3c8baf23-b28c-4711-8fc0-9370d1901c01 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3c8baf23-b28c-4711-8fc0-9370d1901c01 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3c8baf23-b28c-4711-8fc0-9370d1901c01 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3c8baf23-b28c-4711-8fc0-9370d1901c01 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3c8baf23-b28c-4711-8fc0-9370d1901c01 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3c8baf23-b28c-4711-8fc0-9370d1901c01 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-3c8baf23-b28c-4711-8fc0-9370d1901c01 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-3c8baf23-b28c-4711-8fc0-9370d1901c01 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:28:19 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-3c8baf23-b28c-4711-8fc0-9370d1901c01 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:28:19 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-3c8baf23-b28c-4711-8fc0-9370d1901c01 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a" status: 200 len: 1762 microversion: 2.87 time: 0.167707 Apr 13 19:28:19 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 328/975] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:28:19 2023] GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a => generated 1762 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:28:19 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:19 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:19 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-982af315-6b18-45b9-95fd-65612044cd7d req-7b203fa0-8d07-4873-a01f-7be994bb74a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-unplugged", "status": "completed", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:28:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-982af315-6b18-45b9-95fd-65612044cd7d req-7b203fa0-8d07-4873-a01f-7be994bb74a0 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-982af315-6b18-45b9-95fd-65612044cd7d req-7b203fa0-8d07-4873-a01f-7be994bb74a0 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:19 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-982af315-6b18-45b9-95fd-65612044cd7d req-7b203fa0-8d07-4873-a01f-7be994bb74a0 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-982af315-6b18-45b9-95fd-65612044cd7d req-7b203fa0-8d07-4873-a01f-7be994bb74a0 service nova] Creating event network-vif-unplugged:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:28:19 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-982af315-6b18-45b9-95fd-65612044cd7d req-7b203fa0-8d07-4873-a01f-7be994bb74a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088615 Apr 13 19:28:19 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 325/976] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:28:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:28:21 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-plugged", "status": "completed", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}, {"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-plugged", "status": "completed", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:28:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:21 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:21 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] Creating event network-vif-plugged:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:28:21 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] Creating event network-vif-plugged:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:28:21 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032691 Apr 13 19:28:21 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 324/977] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:28:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:28:24 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-d6789246-2933-4963-b2fd-7e99a2550585 req-a115bd1a-c1c3-49f3-954b-00a414d29ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-plugged", "status": "completed", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:28:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d6789246-2933-4963-b2fd-7e99a2550585 req-a115bd1a-c1c3-49f3-954b-00a414d29ae4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d6789246-2933-4963-b2fd-7e99a2550585 req-a115bd1a-c1c3-49f3-954b-00a414d29ae4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d6789246-2933-4963-b2fd-7e99a2550585 req-a115bd1a-c1c3-49f3-954b-00a414d29ae4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:24 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-d6789246-2933-4963-b2fd-7e99a2550585 req-a115bd1a-c1c3-49f3-954b-00a414d29ae4 service nova] Creating event network-vif-plugged:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:28:24 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-d6789246-2933-4963-b2fd-7e99a2550585 req-a115bd1a-c1c3-49f3-954b-00a414d29ae4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029354 Apr 13 19:28:24 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 329/978] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:28:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:28:39 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:39 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:39 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-62992bd8-8440-4088-89aa-1dbac6ccc294 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:28:39 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-62992bd8-8440-4088-89aa-1dbac6ccc294 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-62992bd8-8440-4088-89aa-1dbac6ccc294 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-62992bd8-8440-4088-89aa-1dbac6ccc294 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-62992bd8-8440-4088-89aa-1dbac6ccc294 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-62992bd8-8440-4088-89aa-1dbac6ccc294 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-62992bd8-8440-4088-89aa-1dbac6ccc294 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:39 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-62992bd8-8440-4088-89aa-1dbac6ccc294 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:39 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-62992bd8-8440-4088-89aa-1dbac6ccc294 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:28:39 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-62992bd8-8440-4088-89aa-1dbac6ccc294 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6" status: 200 len: 1535 microversion: 2.1 time: 0.176676 Apr 13 19:28:39 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 326/979] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:28:39 2023] GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => generated 1535 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:28:39 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:39 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:39 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-1d3cf1cb-b858-479e-a198-09df7f594422 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:28:39 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-1d3cf1cb-b858-479e-a198-09df7f594422 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:28:39 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-1d3cf1cb-b858-479e-a198-09df7f594422 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Searching by: {'deleted': False, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886'} {{(pid=61588) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 19:28:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1d3cf1cb-b858-479e-a198-09df7f594422 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1d3cf1cb-b858-479e-a198-09df7f594422 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1d3cf1cb-b858-479e-a198-09df7f594422 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1d3cf1cb-b858-479e-a198-09df7f594422 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1d3cf1cb-b858-479e-a198-09df7f594422 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:39 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-1d3cf1cb-b858-479e-a198-09df7f594422 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:39 user devstack@n-api.service[61588]: DEBUG nova.compute.multi_cell_list [None req-1d3cf1cb-b858-479e-a198-09df7f594422 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 19:28:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-1d3cf1cb-b858-479e-a198-09df7f594422 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.421554 Apr 13 19:28:40 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 325/980] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 19:28:39 2023] GET /compute/v2.1/servers => generated 340 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:28:40 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:40 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=8 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:40 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-ee29277c-c95d-436b-8ce6-0287b0a0ea88 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:28:40 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-ee29277c-c95d-436b-8ce6-0287b0a0ea88 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ee29277c-c95d-436b-8ce6-0287b0a0ea88 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ee29277c-c95d-436b-8ce6-0287b0a0ea88 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ee29277c-c95d-436b-8ce6-0287b0a0ea88 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ee29277c-c95d-436b-8ce6-0287b0a0ea88 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ee29277c-c95d-436b-8ce6-0287b0a0ea88 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-ee29277c-c95d-436b-8ce6-0287b0a0ea88 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:40 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-ee29277c-c95d-436b-8ce6-0287b0a0ea88 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:28:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-ee29277c-c95d-436b-8ce6-0287b0a0ea88 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6" status: 200 len: 1535 microversion: 2.1 time: 0.156143 Apr 13 19:28:40 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 330/981] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:28:40 2023] GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => generated 1535 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:28:40 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d1b20756-db7a-48b7-8650-db14a1f57bb0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:28:40 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-d1b20756-db7a-48b7-8650-db14a1f57bb0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d1b20756-db7a-48b7-8650-db14a1f57bb0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d1b20756-db7a-48b7-8650-db14a1f57bb0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d1b20756-db7a-48b7-8650-db14a1f57bb0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d1b20756-db7a-48b7-8650-db14a1f57bb0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d1b20756-db7a-48b7-8650-db14a1f57bb0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d1b20756-db7a-48b7-8650-db14a1f57bb0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:40 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-d1b20756-db7a-48b7-8650-db14a1f57bb0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:28:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d1b20756-db7a-48b7-8650-db14a1f57bb0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c" status: 200 len: 1549 microversion: 2.1 time: 0.174731 Apr 13 19:28:41 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 327/982] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:28:40 2023] GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:28:41 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:28:41 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:41 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:41 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:28:41 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c" status: 204 len: 0 microversion: 2.1 time: 0.163680 Apr 13 19:28:41 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 326/983] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:28:41 2023] DELETE /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:28:41 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1b292616-05b8-4b26-ac30-0ec96e691c35 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:28:41 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-1b292616-05b8-4b26-ac30-0ec96e691c35 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1b292616-05b8-4b26-ac30-0ec96e691c35 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1b292616-05b8-4b26-ac30-0ec96e691c35 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1b292616-05b8-4b26-ac30-0ec96e691c35 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1b292616-05b8-4b26-ac30-0ec96e691c35 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1b292616-05b8-4b26-ac30-0ec96e691c35 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:41 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1b292616-05b8-4b26-ac30-0ec96e691c35 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:41 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-1b292616-05b8-4b26-ac30-0ec96e691c35 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:28:41 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-1b292616-05b8-4b26-ac30-0ec96e691c35 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c" status: 200 len: 1555 microversion: 2.1 time: 0.191224 Apr 13 19:28:41 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 331/984] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:28:41 2023] GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:28:41 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-9c473a6d-9019-4331-8dc6-be7288791892 req-e814cf00-78d4-4770-8534-24432b3b3aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef84353-ff2d-4835-b160-e801179c0c9c", "name": "network-vif-unplugged", "status": "completed", "tag": "4afa859b-b4dd-4a45-aace-f4ad471db0d6"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:28:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9c473a6d-9019-4331-8dc6-be7288791892 req-e814cf00-78d4-4770-8534-24432b3b3aa5 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9c473a6d-9019-4331-8dc6-be7288791892 req-e814cf00-78d4-4770-8534-24432b3b3aa5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-9c473a6d-9019-4331-8dc6-be7288791892 req-e814cf00-78d4-4770-8534-24432b3b3aa5 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-9c473a6d-9019-4331-8dc6-be7288791892 req-e814cf00-78d4-4770-8534-24432b3b3aa5 service nova] Creating event network-vif-unplugged:4afa859b-b4dd-4a45-aace-f4ad471db0d6 for instance 9ef84353-ff2d-4835-b160-e801179c0c9c on user Apr 13 19:28:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-9c473a6d-9019-4331-8dc6-be7288791892 req-e814cf00-78d4-4770-8534-24432b3b3aa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048280 Apr 13 19:28:41 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 328/985] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:28:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:28:41 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec99b355-2456-4eef-af04-cc75aff66777"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:28:42 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "POST /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437871 Apr 13 19:28:42 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 327/986] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:28:41 2023] POST /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:28:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-402c7823-f988-4769-a4cb-59b26abeff86 req-c06718a1-ff3b-4e7b-8b1e-ea0b8e6464ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef84353-ff2d-4835-b160-e801179c0c9c", "name": "network-vif-deleted", "tag": "4afa859b-b4dd-4a45-aace-f4ad471db0d6"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:28:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-402c7823-f988-4769-a4cb-59b26abeff86 req-c06718a1-ff3b-4e7b-8b1e-ea0b8e6464ee service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-402c7823-f988-4769-a4cb-59b26abeff86 req-c06718a1-ff3b-4e7b-8b1e-ea0b8e6464ee service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-402c7823-f988-4769-a4cb-59b26abeff86 req-c06718a1-ff3b-4e7b-8b1e-ea0b8e6464ee service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-402c7823-f988-4769-a4cb-59b26abeff86 req-c06718a1-ff3b-4e7b-8b1e-ea0b8e6464ee service nova] Creating event network-vif-deleted:4afa859b-b4dd-4a45-aace-f4ad471db0d6 for instance 9ef84353-ff2d-4835-b160-e801179c0c9c on user Apr 13 19:28:43 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-402c7823-f988-4769-a4cb-59b26abeff86 req-c06718a1-ff3b-4e7b-8b1e-ea0b8e6464ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036955 Apr 13 19:28:43 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 332/987] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:28:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:28:43 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-a26db9cc-e1f9-4ccc-8e50-64fc026c990a req-1e2fba32-976f-441c-b328-7c31b82262a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef84353-ff2d-4835-b160-e801179c0c9c", "name": "network-vif-plugged", "status": "completed", "tag": "4afa859b-b4dd-4a45-aace-f4ad471db0d6"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:28:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a26db9cc-e1f9-4ccc-8e50-64fc026c990a req-1e2fba32-976f-441c-b328-7c31b82262a1 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a26db9cc-e1f9-4ccc-8e50-64fc026c990a req-1e2fba32-976f-441c-b328-7c31b82262a1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:43 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a26db9cc-e1f9-4ccc-8e50-64fc026c990a req-1e2fba32-976f-441c-b328-7c31b82262a1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:43 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-a26db9cc-e1f9-4ccc-8e50-64fc026c990a req-1e2fba32-976f-441c-b328-7c31b82262a1 service nova] Creating event network-vif-plugged:4afa859b-b4dd-4a45-aace-f4ad471db0d6 for instance 9ef84353-ff2d-4835-b160-e801179c0c9c on user Apr 13 19:28:43 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-a26db9cc-e1f9-4ccc-8e50-64fc026c990a req-1e2fba32-976f-441c-b328-7c31b82262a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029509 Apr 13 19:28:43 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 329/988] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:28:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:28:53 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:53 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:53 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:53 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-43cfbf4b-9c76-432d-bf54-fc2cca879485 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:28:53 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-43cfbf4b-9c76-432d-bf54-fc2cca879485 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-43cfbf4b-9c76-432d-bf54-fc2cca879485 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-43cfbf4b-9c76-432d-bf54-fc2cca879485 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-43cfbf4b-9c76-432d-bf54-fc2cca879485 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-43cfbf4b-9c76-432d-bf54-fc2cca879485 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-43cfbf4b-9c76-432d-bf54-fc2cca879485 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:53 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-43cfbf4b-9c76-432d-bf54-fc2cca879485 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:53 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-43cfbf4b-9c76-432d-bf54-fc2cca879485 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:28:53 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-43cfbf4b-9c76-432d-bf54-fc2cca879485 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6" status: 200 len: 1581 microversion: 2.1 time: 0.158086 Apr 13 19:28:53 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 328/989] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:28:53 2023] GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => generated 1581 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:28:55 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:55 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=14 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:55 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:28:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:55 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:55 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] Creating event network-changed:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:28:55 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038508 Apr 13 19:28:55 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 333/990] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:28:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:28:56 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=8 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:56 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=16 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:28:56 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-1a15eb7d-caa0-4204-a0b2-48f26f6b8ed5 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1342847108"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:28:56 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-1a15eb7d-caa0-4204-a0b2-48f26f6b8ed5 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1a15eb7d-caa0-4204-a0b2-48f26f6b8ed5 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1a15eb7d-caa0-4204-a0b2-48f26f6b8ed5 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1a15eb7d-caa0-4204-a0b2-48f26f6b8ed5 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1a15eb7d-caa0-4204-a0b2-48f26f6b8ed5 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1a15eb7d-caa0-4204-a0b2-48f26f6b8ed5 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:56 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1a15eb7d-caa0-4204-a0b2-48f26f6b8ed5 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:56 user devstack@n-api.service[61589]: INFO nova.network.security_group_api [None req-1a15eb7d-caa0-4204-a0b2-48f26f6b8ed5 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Adding security group 82523c93-2c97-46f0-9757-09b9131d9d09 to port 18d17551-39ea-401c-95cf-acfdafb210d5 Apr 13 19:28:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-1a15eb7d-caa0-4204-a0b2-48f26f6b8ed5 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "POST /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/action" status: 202 len: 0 microversion: 2.1 time: 0.555569 Apr 13 19:28:56 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 330/991] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:28:56 2023] POST /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:28:56 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:28:56 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-a0b08919-c4ce-4b92-957b-2632ca9d7933 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:28:56 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-a0b08919-c4ce-4b92-957b-2632ca9d7933 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a0b08919-c4ce-4b92-957b-2632ca9d7933 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a0b08919-c4ce-4b92-957b-2632ca9d7933 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a0b08919-c4ce-4b92-957b-2632ca9d7933 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a0b08919-c4ce-4b92-957b-2632ca9d7933 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a0b08919-c4ce-4b92-957b-2632ca9d7933 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-a0b08919-c4ce-4b92-957b-2632ca9d7933 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:56 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:56 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] Creating event network-changed:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:28:56 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031972 Apr 13 19:28:56 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 329/992] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:28:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:28:56 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-a0b08919-c4ce-4b92-957b-2632ca9d7933 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:28:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-a0b08919-c4ce-4b92-957b-2632ca9d7933 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6" status: 200 len: 1746 microversion: 2.1 time: 0.168480 Apr 13 19:28:56 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 334/993] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:28:56 2023] GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:28:59 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:28:59 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:59 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "POST /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/action" status: 202 len: 0 microversion: 2.1 time: 0.092910 Apr 13 19:28:59 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 331/994] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:28:59 2023] POST /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:28:59 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-3cb84f2a-bab1-4c8f-b06e-d7076c4c4b8d tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:28:59 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-3cb84f2a-bab1-4c8f-b06e-d7076c4c4b8d tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:28:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3cb84f2a-bab1-4c8f-b06e-d7076c4c4b8d tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3cb84f2a-bab1-4c8f-b06e-d7076c4c4b8d tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3cb84f2a-bab1-4c8f-b06e-d7076c4c4b8d tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3cb84f2a-bab1-4c8f-b06e-d7076c4c4b8d tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:28:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3cb84f2a-bab1-4c8f-b06e-d7076c4c4b8d tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:28:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3cb84f2a-bab1-4c8f-b06e-d7076c4c4b8d tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:28:59 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-3cb84f2a-bab1-4c8f-b06e-d7076c4c4b8d tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:28:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-3cb84f2a-bab1-4c8f-b06e-d7076c4c4b8d tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6" status: 200 len: 1748 microversion: 2.1 time: 0.166007 Apr 13 19:28:59 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 330/995] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:28:59 2023] GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:29:00 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-2d2e2749-01b2-457d-819a-ad61e051eac5 req-91ef7b80-697d-4276-bc89-77a3cdaa6433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "name": "network-vif-unplugged", "status": "completed", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:29:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2d2e2749-01b2-457d-819a-ad61e051eac5 req-91ef7b80-697d-4276-bc89-77a3cdaa6433 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2d2e2749-01b2-457d-819a-ad61e051eac5 req-91ef7b80-697d-4276-bc89-77a3cdaa6433 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2d2e2749-01b2-457d-819a-ad61e051eac5 req-91ef7b80-697d-4276-bc89-77a3cdaa6433 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:00 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-2d2e2749-01b2-457d-819a-ad61e051eac5 req-91ef7b80-697d-4276-bc89-77a3cdaa6433 service nova] Creating event network-vif-unplugged:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:29:00 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-2d2e2749-01b2-457d-819a-ad61e051eac5 req-91ef7b80-697d-4276-bc89-77a3cdaa6433 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086402 Apr 13 19:29:00 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 335/996] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:29:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:29:02 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-09532e46-572b-4fe6-b19a-b44b56cda1df req-ce810fb7-8697-43fb-9823-5275b53ea529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "name": "network-vif-plugged", "status": "completed", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:29:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-09532e46-572b-4fe6-b19a-b44b56cda1df req-ce810fb7-8697-43fb-9823-5275b53ea529 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-09532e46-572b-4fe6-b19a-b44b56cda1df req-ce810fb7-8697-43fb-9823-5275b53ea529 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:02 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-09532e46-572b-4fe6-b19a-b44b56cda1df req-ce810fb7-8697-43fb-9823-5275b53ea529 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:02 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-09532e46-572b-4fe6-b19a-b44b56cda1df req-ce810fb7-8697-43fb-9823-5275b53ea529 service nova] Creating event network-vif-plugged:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:29:02 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-09532e46-572b-4fe6-b19a-b44b56cda1df req-ce810fb7-8697-43fb-9823-5275b53ea529 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029222 Apr 13 19:29:02 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 332/997] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:29:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:29:04 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-b624cf1b-1cbc-4762-bf3f-408458212090 req-86dcd436-cb4e-4701-b09a-18f7970596df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "name": "network-vif-plugged", "status": "completed", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:29:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b624cf1b-1cbc-4762-bf3f-408458212090 req-86dcd436-cb4e-4701-b09a-18f7970596df service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b624cf1b-1cbc-4762-bf3f-408458212090 req-86dcd436-cb4e-4701-b09a-18f7970596df service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b624cf1b-1cbc-4762-bf3f-408458212090 req-86dcd436-cb4e-4701-b09a-18f7970596df service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:04 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-b624cf1b-1cbc-4762-bf3f-408458212090 req-86dcd436-cb4e-4701-b09a-18f7970596df service nova] Creating event network-vif-plugged:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:29:04 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-b624cf1b-1cbc-4762-bf3f-408458212090 req-86dcd436-cb4e-4701-b09a-18f7970596df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057330 Apr 13 19:29:04 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 331/998] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:29:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:29:06 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-d51f2579-73d2-488e-a5dd-dd3d4b8a5487 req-16cfb550-7ae4-4b63-ba87-1426fb545b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "name": "network-vif-plugged", "status": "completed", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:29:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d51f2579-73d2-488e-a5dd-dd3d4b8a5487 req-16cfb550-7ae4-4b63-ba87-1426fb545b12 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d51f2579-73d2-488e-a5dd-dd3d4b8a5487 req-16cfb550-7ae4-4b63-ba87-1426fb545b12 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:06 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d51f2579-73d2-488e-a5dd-dd3d4b8a5487 req-16cfb550-7ae4-4b63-ba87-1426fb545b12 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:06 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-d51f2579-73d2-488e-a5dd-dd3d4b8a5487 req-16cfb550-7ae4-4b63-ba87-1426fb545b12 service nova] Creating event network-vif-plugged:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:29:06 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-d51f2579-73d2-488e-a5dd-dd3d4b8a5487 req-16cfb550-7ae4-4b63-ba87-1426fb545b12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031086 Apr 13 19:29:06 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 336/999] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:29:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:29:09 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-7bd4be3e-8515-4b4a-ae97-a4d5383e46ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:29:09 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-7bd4be3e-8515-4b4a-ae97-a4d5383e46ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:29:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7bd4be3e-8515-4b4a-ae97-a4d5383e46ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7bd4be3e-8515-4b4a-ae97-a4d5383e46ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7bd4be3e-8515-4b4a-ae97-a4d5383e46ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7bd4be3e-8515-4b4a-ae97-a4d5383e46ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7bd4be3e-8515-4b4a-ae97-a4d5383e46ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:09 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-7bd4be3e-8515-4b4a-ae97-a4d5383e46ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:09 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-7bd4be3e-8515-4b4a-ae97-a4d5383e46ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:29:09 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-7bd4be3e-8515-4b4a-ae97-a4d5383e46ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:29:09 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-7bd4be3e-8515-4b4a-ae97-a4d5383e46ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:29:09 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-7bd4be3e-8515-4b4a-ae97-a4d5383e46ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a" status: 200 len: 1768 microversion: 2.87 time: 0.224267 Apr 13 19:29:09 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 333/1000] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:29:09 2023] GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a => generated 1768 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:29:31 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=8 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:29:31 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=16 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:29:31 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-07ec02bf-7f8e-48e0-8fe8-41b6b013e1c5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:29:31 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-07ec02bf-7f8e-48e0-8fe8-41b6b013e1c5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:29:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-07ec02bf-7f8e-48e0-8fe8-41b6b013e1c5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-07ec02bf-7f8e-48e0-8fe8-41b6b013e1c5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-07ec02bf-7f8e-48e0-8fe8-41b6b013e1c5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-07ec02bf-7f8e-48e0-8fe8-41b6b013e1c5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-07ec02bf-7f8e-48e0-8fe8-41b6b013e1c5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-07ec02bf-7f8e-48e0-8fe8-41b6b013e1c5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-07ec02bf-7f8e-48e0-8fe8-41b6b013e1c5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:29:31 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-07ec02bf-7f8e-48e0-8fe8-41b6b013e1c5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:29:31 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c HTTP/1.1 Apr 13 19:29:31 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:29:31 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:29:31 user devstack@n-api.service[61588]: Connection: close Apr 13 19:29:31 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:29:31 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:29:31 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:29:31 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:29:31 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:29:31 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:29:31 user devstack@n-api.service[61588]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:29:31 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:29:31 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:29:31 user devstack@n-api.service[61588]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:29:31 user devstack@n-api.service[61588]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:29:31 user devstack@n-api.service[61588]: method: > Apr 13 19:29:31 user devstack@n-api.service[61588]: exception: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:29:31 user devstack@n-api.service[61588]: action_args: {'id': '9ef84353-ff2d-4835-b160-e801179c0c9c'} Apr 13 19:29:31 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:29:31 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:29:31 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-07ec02bf-7f8e-48e0-8fe8-41b6b013e1c5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:29:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-07ec02bf-7f8e-48e0-8fe8-41b6b013e1c5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c" status: 404 len: 111 microversion: 2.1 time: 0.042017 Apr 13 19:29:31 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 332/1001] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:29:31 2023] GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:29:33 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=8 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:29:33 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=12 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:29:33 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:29:33 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:29:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:33 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:29:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772" status: 204 len: 0 microversion: 2.1 time: 0.126060 Apr 13 19:29:33 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 337/1002] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:29:33 2023] DELETE /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:29:33 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-3c0a13f6-f9e7-4f3b-b6f0-ed9237b5057a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:29:33 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-3c0a13f6-f9e7-4f3b-b6f0-ed9237b5057a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:29:33 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:29:33 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=10 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:29:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3c0a13f6-f9e7-4f3b-b6f0-ed9237b5057a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3c0a13f6-f9e7-4f3b-b6f0-ed9237b5057a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3c0a13f6-f9e7-4f3b-b6f0-ed9237b5057a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3c0a13f6-f9e7-4f3b-b6f0-ed9237b5057a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3c0a13f6-f9e7-4f3b-b6f0-ed9237b5057a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-3c0a13f6-f9e7-4f3b-b6f0-ed9237b5057a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-dda9ca7a-7a21-4205-b9ab-a8f253c98507 req-c06e2db5-fcec-4d75-a95f-6d90529ce7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f05f7e3-6b1d-42bb-a567-ebfab8001772", "name": "network-vif-unplugged", "status": "completed", "tag": "d4720014-5ce3-41b2-80e7-02fc430417f3"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:29:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-dda9ca7a-7a21-4205-b9ab-a8f253c98507 req-c06e2db5-fcec-4d75-a95f-6d90529ce7d8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-dda9ca7a-7a21-4205-b9ab-a8f253c98507 req-c06e2db5-fcec-4d75-a95f-6d90529ce7d8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-dda9ca7a-7a21-4205-b9ab-a8f253c98507 req-c06e2db5-fcec-4d75-a95f-6d90529ce7d8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-dda9ca7a-7a21-4205-b9ab-a8f253c98507 req-c06e2db5-fcec-4d75-a95f-6d90529ce7d8 service nova] Creating event network-vif-unplugged:d4720014-5ce3-41b2-80e7-02fc430417f3 for instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 on user Apr 13 19:29:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-dda9ca7a-7a21-4205-b9ab-a8f253c98507 req-c06e2db5-fcec-4d75-a95f-6d90529ce7d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037172 Apr 13 19:29:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 333/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:29:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:29:34 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-3c0a13f6-f9e7-4f3b-b6f0-ed9237b5057a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:29:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-3c0a13f6-f9e7-4f3b-b6f0-ed9237b5057a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772" status: 200 len: 1398 microversion: 2.1 time: 0.504358 Apr 13 19:29:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 334/1004] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:29:33 2023] GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772 => generated 1398 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:29:35 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-cc8644f8-f86d-43b1-8d40-b8fe9634d4e6 req-114b92e7-3d6e-4dce-ba24-1d3abfc2a22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f05f7e3-6b1d-42bb-a567-ebfab8001772", "name": "network-vif-deleted", "tag": "d4720014-5ce3-41b2-80e7-02fc430417f3"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:29:35 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-cc8644f8-f86d-43b1-8d40-b8fe9634d4e6 req-114b92e7-3d6e-4dce-ba24-1d3abfc2a22e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:36 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-cc8644f8-f86d-43b1-8d40-b8fe9634d4e6 req-114b92e7-3d6e-4dce-ba24-1d3abfc2a22e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:36 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-cc8644f8-f86d-43b1-8d40-b8fe9634d4e6 req-114b92e7-3d6e-4dce-ba24-1d3abfc2a22e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:36 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-cc8644f8-f86d-43b1-8d40-b8fe9634d4e6 req-114b92e7-3d6e-4dce-ba24-1d3abfc2a22e service nova] Creating event network-vif-deleted:d4720014-5ce3-41b2-80e7-02fc430417f3 for instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 on user Apr 13 19:29:36 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-cc8644f8-f86d-43b1-8d40-b8fe9634d4e6 req-114b92e7-3d6e-4dce-ba24-1d3abfc2a22e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038344 Apr 13 19:29:36 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 338/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:29:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:29:36 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-ab7ea6fa-cb6e-489f-ab3b-fdcea4b6fb72 req-aaa30b7a-ddf4-4fe4-aeb2-62c730f32e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f05f7e3-6b1d-42bb-a567-ebfab8001772", "name": "network-vif-plugged", "status": "completed", "tag": "d4720014-5ce3-41b2-80e7-02fc430417f3"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:29:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ab7ea6fa-cb6e-489f-ab3b-fdcea4b6fb72 req-aaa30b7a-ddf4-4fe4-aeb2-62c730f32e2d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ab7ea6fa-cb6e-489f-ab3b-fdcea4b6fb72 req-aaa30b7a-ddf4-4fe4-aeb2-62c730f32e2d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:36 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ab7ea6fa-cb6e-489f-ab3b-fdcea4b6fb72 req-aaa30b7a-ddf4-4fe4-aeb2-62c730f32e2d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:36 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-ab7ea6fa-cb6e-489f-ab3b-fdcea4b6fb72 req-aaa30b7a-ddf4-4fe4-aeb2-62c730f32e2d service nova] Creating event network-vif-plugged:d4720014-5ce3-41b2-80e7-02fc430417f3 for instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 on user Apr 13 19:29:36 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-ab7ea6fa-cb6e-489f-ab3b-fdcea4b6fb72 req-aaa30b7a-ddf4-4fe4-aeb2-62c730f32e2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029347 Apr 13 19:29:36 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 334/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:29:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:29:49 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f3543c17-7230-4562-87db-6f4b02321486 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:29:49 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f3543c17-7230-4562-87db-6f4b02321486 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:29:49 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:29:49 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:29:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f3543c17-7230-4562-87db-6f4b02321486 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f3543c17-7230-4562-87db-6f4b02321486 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f3543c17-7230-4562-87db-6f4b02321486 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f3543c17-7230-4562-87db-6f4b02321486 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:29:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f3543c17-7230-4562-87db-6f4b02321486 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:29:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f3543c17-7230-4562-87db-6f4b02321486 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:29:49 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-f3543c17-7230-4562-87db-6f4b02321486 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:29:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f3543c17-7230-4562-87db-6f4b02321486 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6" status: 200 len: 1746 microversion: 2.1 time: 0.155496 Apr 13 19:29:49 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 335/1007] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:29:49 2023] GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:30:09 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1651036996", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "networks": [{"uuid": "09341996-8218-4461-9635-d3f9187c1d42"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:30:09 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:09 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:09 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] validate_networks() for [('09341996-8218-4461-9635-d3f9187c1d42', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting quotas for project c00a7fcd6d3040e8b2db0448eeda93ad. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting quotas for user dd604fa4d17b42b1abea8c2f2405b58d and project c00a7fcd6d3040e8b2db0448eeda93ad. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:30:10 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:30:10 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.769032 Apr 13 19:30:10 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 339/1008] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 19:30:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 19:30:10 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:10 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:10 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f4814292-017a-469c-abc4-42389e7d32a8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:30:10 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f4814292-017a-469c-abc4-42389e7d32a8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:30:10 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-f4814292-017a-469c-abc4-42389e7d32a8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:30:10 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-f4814292-017a-469c-abc4-42389e7d32a8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:30:10 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-f4814292-017a-469c-abc4-42389e7d32a8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:30:10 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-f4814292-017a-469c-abc4-42389e7d32a8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" status: 200 len: 1395 microversion: 2.87 time: 0.082661 Apr 13 19:30:10 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 335/1009] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:30:10 2023] GET /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 => generated 1395 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:30:12 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6", "tag": "89ac5520-b022-42dd-a10d-6621de9ecd5f"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:30:12 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:12 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] Creating event network-changed:89ac5520-b022-42dd-a10d-6621de9ecd5f for instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 on user Apr 13 19:30:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034376 Apr 13 19:30:12 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 336/1010] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:30:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:30:14 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-e1917db6-da4d-462b-bd7b-905ddf56e8aa req-1b49fe89-770a-41f4-b063-4ed9a38dd051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6", "name": "network-vif-plugged", "status": "completed", "tag": "89ac5520-b022-42dd-a10d-6621de9ecd5f"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:30:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e1917db6-da4d-462b-bd7b-905ddf56e8aa req-1b49fe89-770a-41f4-b063-4ed9a38dd051 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e1917db6-da4d-462b-bd7b-905ddf56e8aa req-1b49fe89-770a-41f4-b063-4ed9a38dd051 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:14 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-e1917db6-da4d-462b-bd7b-905ddf56e8aa req-1b49fe89-770a-41f4-b063-4ed9a38dd051 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:14 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-e1917db6-da4d-462b-bd7b-905ddf56e8aa req-1b49fe89-770a-41f4-b063-4ed9a38dd051 service nova] Creating event network-vif-plugged:89ac5520-b022-42dd-a10d-6621de9ecd5f for instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 on user Apr 13 19:30:14 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-e1917db6-da4d-462b-bd7b-905ddf56e8aa req-1b49fe89-770a-41f4-b063-4ed9a38dd051 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083185 Apr 13 19:30:14 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 340/1011] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:30:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:30:16 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-163a34ef-c4c8-416e-a534-9c75e6762a99 req-15e11c44-0571-46e2-b978-644d9d279979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6", "name": "network-vif-plugged", "status": "completed", "tag": "89ac5520-b022-42dd-a10d-6621de9ecd5f"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:30:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-163a34ef-c4c8-416e-a534-9c75e6762a99 req-15e11c44-0571-46e2-b978-644d9d279979 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-163a34ef-c4c8-416e-a534-9c75e6762a99 req-15e11c44-0571-46e2-b978-644d9d279979 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:16 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-163a34ef-c4c8-416e-a534-9c75e6762a99 req-15e11c44-0571-46e2-b978-644d9d279979 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:16 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-163a34ef-c4c8-416e-a534-9c75e6762a99 req-15e11c44-0571-46e2-b978-644d9d279979 service nova] Creating event network-vif-plugged:89ac5520-b022-42dd-a10d-6621de9ecd5f for instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 on user Apr 13 19:30:16 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-163a34ef-c4c8-416e-a534-9c75e6762a99 req-15e11c44-0571-46e2-b978-644d9d279979 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030069 Apr 13 19:30:16 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 336/1012] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:30:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-268142fc-b1e2-4bdf-945a-dd3d75643330 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-268142fc-b1e2-4bdf-945a-dd3d75643330 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-268142fc-b1e2-4bdf-945a-dd3d75643330 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-268142fc-b1e2-4bdf-945a-dd3d75643330 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-268142fc-b1e2-4bdf-945a-dd3d75643330 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-268142fc-b1e2-4bdf-945a-dd3d75643330 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-268142fc-b1e2-4bdf-945a-dd3d75643330 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-268142fc-b1e2-4bdf-945a-dd3d75643330 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-268142fc-b1e2-4bdf-945a-dd3d75643330 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-268142fc-b1e2-4bdf-945a-dd3d75643330 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:30:24 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772 HTTP/1.1 Apr 13 19:30:24 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:30:24 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:30:24 user devstack@n-api.service[61589]: Connection: close Apr 13 19:30:24 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:30:24 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:30:24 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:30:24 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:30:24 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61589]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:30:24 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:30:24 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:30:24 user devstack@n-api.service[61589]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:30:24 user devstack@n-api.service[61589]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:30:24 user devstack@n-api.service[61589]: method: > Apr 13 19:30:24 user devstack@n-api.service[61589]: exception: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61589]: action_args: {'id': '4f05f7e3-6b1d-42bb-a567-ebfab8001772'} Apr 13 19:30:24 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-268142fc-b1e2-4bdf-945a-dd3d75643330 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:30:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-268142fc-b1e2-4bdf-945a-dd3d75643330 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772" status: 404 len: 111 microversion: 2.1 time: 0.040991 Apr 13 19:30:24 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 337/1013] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:30:24 2023] GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-91fb7633-5d83-43ef-a0ee-2b4ed086d2d4 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-91fb7633-5d83-43ef-a0ee-2b4ed086d2d4 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91fb7633-5d83-43ef-a0ee-2b4ed086d2d4 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91fb7633-5d83-43ef-a0ee-2b4ed086d2d4 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91fb7633-5d83-43ef-a0ee-2b4ed086d2d4 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91fb7633-5d83-43ef-a0ee-2b4ed086d2d4 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91fb7633-5d83-43ef-a0ee-2b4ed086d2d4 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-91fb7633-5d83-43ef-a0ee-2b4ed086d2d4 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:24 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-91fb7633-5d83-43ef-a0ee-2b4ed086d2d4 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-91fb7633-5d83-43ef-a0ee-2b4ed086d2d4 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:30:24 user devstack@n-api.service[61587]: request: DELETE /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c HTTP/1.1 Apr 13 19:30:24 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:30:24 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:30:24 user devstack@n-api.service[61587]: Connection: close Apr 13 19:30:24 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:30:24 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:30:24 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:30:24 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:30:24 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61587]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:30:24 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:30:24 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:30:24 user devstack@n-api.service[61587]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:30:24 user devstack@n-api.service[61587]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:30:24 user devstack@n-api.service[61587]: method: > Apr 13 19:30:24 user devstack@n-api.service[61587]: exception: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:30:24 user devstack@n-api.service[61587]: action_args: {'id': '9ef84353-ff2d-4835-b160-e801179c0c9c'} Apr 13 19:30:24 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-91fb7633-5d83-43ef-a0ee-2b4ed086d2d4 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:30:24 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-91fb7633-5d83-43ef-a0ee-2b4ed086d2d4 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c" status: 404 len: 111 microversion: 2.1 time: 0.034749 Apr 13 19:30:24 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 341/1014] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:30:24 2023] DELETE /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:30:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a4065db0-6eaa-47aa-8bfc-ad982b2bbe0d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:30:24 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-a4065db0-6eaa-47aa-8bfc-ad982b2bbe0d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:30:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a4065db0-6eaa-47aa-8bfc-ad982b2bbe0d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a4065db0-6eaa-47aa-8bfc-ad982b2bbe0d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a4065db0-6eaa-47aa-8bfc-ad982b2bbe0d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a4065db0-6eaa-47aa-8bfc-ad982b2bbe0d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a4065db0-6eaa-47aa-8bfc-ad982b2bbe0d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a4065db0-6eaa-47aa-8bfc-ad982b2bbe0d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-a4065db0-6eaa-47aa-8bfc-ad982b2bbe0d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:30:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a4065db0-6eaa-47aa-8bfc-ad982b2bbe0d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:30:24 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c HTTP/1.1 Apr 13 19:30:24 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:30:24 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:30:24 user devstack@n-api.service[61588]: Connection: close Apr 13 19:30:24 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:30:24 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:30:24 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:30:24 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:30:24 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:30:24 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61588]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:30:24 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:30:24 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:30:24 user devstack@n-api.service[61588]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:30:24 user devstack@n-api.service[61588]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:30:24 user devstack@n-api.service[61588]: method: > Apr 13 19:30:24 user devstack@n-api.service[61588]: exception: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:30:24 user devstack@n-api.service[61588]: action_args: {'id': '9ef84353-ff2d-4835-b160-e801179c0c9c'} Apr 13 19:30:24 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. Apr 13 19:30:24 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a4065db0-6eaa-47aa-8bfc-ad982b2bbe0d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:30:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-a4065db0-6eaa-47aa-8bfc-ad982b2bbe0d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c" status: 404 len: 111 microversion: 2.1 time: 0.034946 Apr 13 19:30:24 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 337/1015] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:30:24 2023] GET /compute/v2.1/servers/9ef84353-ff2d-4835-b160-e801179c0c9c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-c2345b15-d935-40a2-8dbd-285aa55bbb7d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-c2345b15-d935-40a2-8dbd-285aa55bbb7d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c2345b15-d935-40a2-8dbd-285aa55bbb7d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c2345b15-d935-40a2-8dbd-285aa55bbb7d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c2345b15-d935-40a2-8dbd-285aa55bbb7d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c2345b15-d935-40a2-8dbd-285aa55bbb7d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c2345b15-d935-40a2-8dbd-285aa55bbb7d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c2345b15-d935-40a2-8dbd-285aa55bbb7d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-c2345b15-d935-40a2-8dbd-285aa55bbb7d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-c2345b15-d935-40a2-8dbd-285aa55bbb7d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:30:24 user devstack@n-api.service[61589]: request: DELETE /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772 HTTP/1.1 Apr 13 19:30:24 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:30:24 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:30:24 user devstack@n-api.service[61589]: Connection: close Apr 13 19:30:24 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:30:24 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:30:24 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:30:24 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:30:24 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:30:24 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61589]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:30:24 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:30:24 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:30:24 user devstack@n-api.service[61589]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:30:24 user devstack@n-api.service[61589]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:30:24 user devstack@n-api.service[61589]: method: > Apr 13 19:30:24 user devstack@n-api.service[61589]: exception: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61589]: action_args: {'id': '4f05f7e3-6b1d-42bb-a567-ebfab8001772'} Apr 13 19:30:24 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-c2345b15-d935-40a2-8dbd-285aa55bbb7d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:30:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-c2345b15-d935-40a2-8dbd-285aa55bbb7d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772" status: 404 len: 111 microversion: 2.1 time: 0.029586 Apr 13 19:30:24 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 338/1016] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:30:24 2023] DELETE /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3c1b3a2a-b4eb-4c44-9507-b6bca19c5861 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-3c1b3a2a-b4eb-4c44-9507-b6bca19c5861 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3c1b3a2a-b4eb-4c44-9507-b6bca19c5861 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3c1b3a2a-b4eb-4c44-9507-b6bca19c5861 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3c1b3a2a-b4eb-4c44-9507-b6bca19c5861 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3c1b3a2a-b4eb-4c44-9507-b6bca19c5861 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3c1b3a2a-b4eb-4c44-9507-b6bca19c5861 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3c1b3a2a-b4eb-4c44-9507-b6bca19c5861 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:24 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-3c1b3a2a-b4eb-4c44-9507-b6bca19c5861 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3c1b3a2a-b4eb-4c44-9507-b6bca19c5861 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:30:24 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772 HTTP/1.1 Apr 13 19:30:24 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:30:24 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:30:24 user devstack@n-api.service[61587]: Connection: close Apr 13 19:30:24 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:30:24 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:30:24 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:30:24 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:30:24 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:30:24 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:30:24 user devstack@n-api.service[61587]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:30:24 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:30:24 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:30:24 user devstack@n-api.service[61587]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:30:24 user devstack@n-api.service[61587]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:30:24 user devstack@n-api.service[61587]: method: > Apr 13 19:30:24 user devstack@n-api.service[61587]: exception: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61587]: action_args: {'id': '4f05f7e3-6b1d-42bb-a567-ebfab8001772'} Apr 13 19:30:24 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. Apr 13 19:30:24 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:30:24 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3c1b3a2a-b4eb-4c44-9507-b6bca19c5861 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:30:24 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-3c1b3a2a-b4eb-4c44-9507-b6bca19c5861 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772" status: 404 len: 111 microversion: 2.1 time: 0.031414 Apr 13 19:30:24 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 342/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:30:24 2023] GET /compute/v2.1/servers/4f05f7e3-6b1d-42bb-a567-ebfab8001772 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:30:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-db99facd-d2a6-4320-8e56-5fa992855ca9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Action: 'create', calling method: .version_select at 0x7efe33faa050>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1410205426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj7TcL9FU0ycuamYqYTfleaq2m4r0SEirSHRlkPBcG/eCMlwnGnrLneKNOsIY4WhqDyz6ZvULFdimsQ4U+9lxxBdfuyuTJJKa1K6nRrg6kFRx2pkuS1DtxEUpZtRdywRA=="}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:30:25 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-db99facd-d2a6-4320-8e56-5fa992855ca9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for project a5231d999e51417ebe91927707bfd2bd. Resources: {'key_pairs'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:30:25 user devstack@n-api.service[61588]: DEBUG nova.quota [None req-db99facd-d2a6-4320-8e56-5fa992855ca9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for user 526d9c809b81418d89da662f973a1bdc and project a5231d999e51417ebe91927707bfd2bd. Resources: {'key_pairs'} {{(pid=61588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:30:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-db99facd-d2a6-4320-8e56-5fa992855ca9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.062151 Apr 13 19:30:25 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 338/1018] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:30:25 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:30:28 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-46900522", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1410205426", "security_groups": [{"name": "tempest-secgroup-smoke-892708207"}], "block_device_mapping_v2": [{"uuid": "859d56a6-4c86-402c-9b6c-564c027c53d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "824b1924-526b-40ac-95d3-6927aa9656c4"}]}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] validate_networks() for [('824b1924-526b-40ac-95d3-6927aa9656c4', None, None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for project a5231d999e51417ebe91927707bfd2bd. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for user 526d9c809b81418d89da662f973a1bdc and project a5231d999e51417ebe91927707bfd2bd. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:30:29 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='859d56a6-4c86-402c-9b6c-564c027c53d5',volume_size=None,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:30:29 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.734904 Apr 13 19:30:29 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 339/1019] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:30:28 2023] POST /compute/v2.1/servers => generated 403 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:30:29 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-fcf14f80-3939-419a-8518-786fb6d3188d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:30:29 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-fcf14f80-3939-419a-8518-786fb6d3188d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:30:29 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-fcf14f80-3939-419a-8518-786fb6d3188d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:30:29 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-fcf14f80-3939-419a-8518-786fb6d3188d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800" status: 200 len: 1088 microversion: 2.1 time: 0.101341 Apr 13 19:30:29 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 343/1020] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:30:29 2023] GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800 => generated 1088 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:30:32 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbd7e115-1fc0-4c57-8ed8-eee343b69800", "tag": "78719f53-87de-44f2-b6f3-f2d77851fce0"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:30:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:32 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:32 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] Creating event network-changed:78719f53-87de-44f2-b6f3-f2d77851fce0 for instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 on user Apr 13 19:30:32 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052615 Apr 13 19:30:32 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 339/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:30:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:30:38 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-961c8144-34b5-46eb-8a7f-7876053d9ff9 req-503a66f6-51e4-43b1-a519-9836fd106412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd7e115-1fc0-4c57-8ed8-eee343b69800", "name": "network-vif-plugged", "status": "completed", "tag": "78719f53-87de-44f2-b6f3-f2d77851fce0"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:30:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-961c8144-34b5-46eb-8a7f-7876053d9ff9 req-503a66f6-51e4-43b1-a519-9836fd106412 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-961c8144-34b5-46eb-8a7f-7876053d9ff9 req-503a66f6-51e4-43b1-a519-9836fd106412 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:38 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-961c8144-34b5-46eb-8a7f-7876053d9ff9 req-503a66f6-51e4-43b1-a519-9836fd106412 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:38 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-961c8144-34b5-46eb-8a7f-7876053d9ff9 req-503a66f6-51e4-43b1-a519-9836fd106412 service nova] Creating event network-vif-plugged:78719f53-87de-44f2-b6f3-f2d77851fce0 for instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 on user Apr 13 19:30:38 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-961c8144-34b5-46eb-8a7f-7876053d9ff9 req-503a66f6-51e4-43b1-a519-9836fd106412 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056416 Apr 13 19:30:38 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 340/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:30:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:30:40 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=8 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:40 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:40 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:40 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-7bbbd861-1efa-4b98-878b-d506ce843776 req-5655a5d2-4349-4d0b-9856-b21766a32c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd7e115-1fc0-4c57-8ed8-eee343b69800", "name": "network-vif-plugged", "status": "completed", "tag": "78719f53-87de-44f2-b6f3-f2d77851fce0"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:30:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-7bbbd861-1efa-4b98-878b-d506ce843776 req-5655a5d2-4349-4d0b-9856-b21766a32c91 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-7bbbd861-1efa-4b98-878b-d506ce843776 req-5655a5d2-4349-4d0b-9856-b21766a32c91 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-7bbbd861-1efa-4b98-878b-d506ce843776 req-5655a5d2-4349-4d0b-9856-b21766a32c91 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-7bbbd861-1efa-4b98-878b-d506ce843776 req-5655a5d2-4349-4d0b-9856-b21766a32c91 service nova] Creating event network-vif-plugged:78719f53-87de-44f2-b6f3-f2d77851fce0 for instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 on user Apr 13 19:30:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-7bbbd861-1efa-4b98-878b-d506ce843776 req-5655a5d2-4349-4d0b-9856-b21766a32c91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044227 Apr 13 19:30:40 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 344/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:30:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:30:50 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:50 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:50 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:50 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-f4d8d296-f153-4ce7-80ab-246937394387 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1342847108"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:30:50 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-f4d8d296-f153-4ce7-80ab-246937394387 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:30:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f4d8d296-f153-4ce7-80ab-246937394387 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f4d8d296-f153-4ce7-80ab-246937394387 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f4d8d296-f153-4ce7-80ab-246937394387 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f4d8d296-f153-4ce7-80ab-246937394387 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f4d8d296-f153-4ce7-80ab-246937394387 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-f4d8d296-f153-4ce7-80ab-246937394387 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:50 user devstack@n-api.service[61588]: INFO nova.network.security_group_api [None req-f4d8d296-f153-4ce7-80ab-246937394387 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Removing security group 82523c93-2c97-46f0-9757-09b9131d9d09 from port 18d17551-39ea-401c-95cf-acfdafb210d5 Apr 13 19:30:50 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-f4d8d296-f153-4ce7-80ab-246937394387 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "POST /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/action" status: 202 len: 0 microversion: 2.1 time: 0.570849 Apr 13 19:30:50 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 340/1024] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:30:50 2023] POST /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:30:50 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:50 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:50 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:50 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=8 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:50 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:30:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:50 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] Creating event network-changed:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:30:50 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065075 Apr 13 19:30:50 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 341/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:30:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:30:51 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:51 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:30:51 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:30:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:51 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:51 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] Creating event network-changed:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:30:51 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033811 Apr 13 19:30:51 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 345/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:30:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:30:51 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:30:51 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:30:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:51 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:51 user devstack@n-api.service[61588]: DEBUG nova.objects.instance [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'services' on Instance uuid 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=61588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:30:51 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/os-volume_attachments/ec99b355-2456-4eef-af04-cc75aff66777" status: 202 len: 0 microversion: 2.1 time: 0.179140 Apr 13 19:30:51 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 341/1027] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:30:51 2023] DELETE /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/os-volume_attachments/ec99b355-2456-4eef-af04-cc75aff66777 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:30:51 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-c011c65e-a603-4615-a415-7184d14ec4ca tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:30:51 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-c011c65e-a603-4615-a415-7184d14ec4ca tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:30:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c011c65e-a603-4615-a415-7184d14ec4ca tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c011c65e-a603-4615-a415-7184d14ec4ca tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c011c65e-a603-4615-a415-7184d14ec4ca tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c011c65e-a603-4615-a415-7184d14ec4ca tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:30:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c011c65e-a603-4615-a415-7184d14ec4ca tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:30:52 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-c011c65e-a603-4615-a415-7184d14ec4ca tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:30:52 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-c011c65e-a603-4615-a415-7184d14ec4ca tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049766 Apr 13 19:30:52 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 342/1028] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:30:51 2023] GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:31:00 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-f876c59c-0a35-4382-aafb-518e2c8adb9c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:31:00 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-f876c59c-0a35-4382-aafb-518e2c8adb9c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:31:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f876c59c-0a35-4382-aafb-518e2c8adb9c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f876c59c-0a35-4382-aafb-518e2c8adb9c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f876c59c-0a35-4382-aafb-518e2c8adb9c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f876c59c-0a35-4382-aafb-518e2c8adb9c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f876c59c-0a35-4382-aafb-518e2c8adb9c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f876c59c-0a35-4382-aafb-518e2c8adb9c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:00 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-f876c59c-0a35-4382-aafb-518e2c8adb9c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:31:00 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-f876c59c-0a35-4382-aafb-518e2c8adb9c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:31:00 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-f876c59c-0a35-4382-aafb-518e2c8adb9c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:31:00 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-f876c59c-0a35-4382-aafb-518e2c8adb9c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" status: 200 len: 1690 microversion: 2.87 time: 0.211758 Apr 13 19:31:00 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 346/1029] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:31:00 2023] GET /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 => generated 1690 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:31:19 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:31:19 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:31:19 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-3936ee09-41c7-4591-bf59-dca19e3f4ac3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:31:19 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-3936ee09-41c7-4591-bf59-dca19e3f4ac3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:31:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3936ee09-41c7-4591-bf59-dca19e3f4ac3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3936ee09-41c7-4591-bf59-dca19e3f4ac3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3936ee09-41c7-4591-bf59-dca19e3f4ac3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3936ee09-41c7-4591-bf59-dca19e3f4ac3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3936ee09-41c7-4591-bf59-dca19e3f4ac3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:19 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-3936ee09-41c7-4591-bf59-dca19e3f4ac3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:19 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-3936ee09-41c7-4591-bf59-dca19e3f4ac3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:31:19 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-3936ee09-41c7-4591-bf59-dca19e3f4ac3 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800" status: 200 len: 1440 microversion: 2.1 time: 0.176404 Apr 13 19:31:19 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 342/1030] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:31:19 2023] GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800 => generated 1440 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:31:42 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9884c082-a63e-4fe6-848f-1aa8ba604335 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:31:42 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-9884c082-a63e-4fe6-848f-1aa8ba604335 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:31:42 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:31:42 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=8 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:31:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9884c082-a63e-4fe6-848f-1aa8ba604335 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9884c082-a63e-4fe6-848f-1aa8ba604335 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9884c082-a63e-4fe6-848f-1aa8ba604335 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9884c082-a63e-4fe6-848f-1aa8ba604335 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9884c082-a63e-4fe6-848f-1aa8ba604335 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9884c082-a63e-4fe6-848f-1aa8ba604335 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:42 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-9884c082-a63e-4fe6-848f-1aa8ba604335 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053094 Apr 13 19:31:42 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 343/1031] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:31:42 2023] GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:31:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3f8d904d-bf5b-444e-8514-ff4a5180e92f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:31:42 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-3f8d904d-bf5b-444e-8514-ff4a5180e92f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:31:42 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=8 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:31:42 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:31:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3f8d904d-bf5b-444e-8514-ff4a5180e92f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3f8d904d-bf5b-444e-8514-ff4a5180e92f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3f8d904d-bf5b-444e-8514-ff4a5180e92f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3f8d904d-bf5b-444e-8514-ff4a5180e92f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3f8d904d-bf5b-444e-8514-ff4a5180e92f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-3f8d904d-bf5b-444e-8514-ff4a5180e92f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-3f8d904d-bf5b-444e-8514-ff4a5180e92f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] HTTP exception thrown: Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 is not attached to volume ec99b355-2456-4eef-af04-cc75aff66777 Apr 13 19:31:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3f8d904d-bf5b-444e-8514-ff4a5180e92f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Request method failure captured: Apr 13 19:31:42 user devstack@n-api.service[61587]: request: DELETE /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/os-volume_attachments/ec99b355-2456-4eef-af04-cc75aff66777 HTTP/1.1 Apr 13 19:31:42 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:31:42 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:31:42 user devstack@n-api.service[61587]: Connection: close Apr 13 19:31:42 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:31:42 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:31:42 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:31:42 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:31:42 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFdvUUNU3CyZfYq8lEiyknYArK8nkfrpiGCt9b8fTam0ipMnKPXUwxym-ZMuQE95pg5AM-XyAxuWw_Iwfsc0moQXJ1PD_km4KJ5j8ysffj-w-BZzcryYhn-EGsEISGrf0aVCPD-1rJmkvNHdmqgf35ImrndabMYEfBojUzhyScvCiUw Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Project-Id: ba0e42217cc44413951d6d5a87dbb886 Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Project-Name: tempest-TestMinimumBasicScenario-8202894 Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba0e42217cc44413951d6d5a87dbb886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ba0e42217cc44413951d6d5a87dbb886"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba0e42217cc44413951d6d5a87dbb886"}]}] Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Tenant: tempest-TestMinimumBasicScenario-8202894 Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Tenant-Id: ba0e42217cc44413951d6d5a87dbb886 Apr 13 19:31:42 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-TestMinimumBasicScenario-8202894 Apr 13 19:31:42 user devstack@n-api.service[61587]: X-User: tempest-TestMinimumBasicScenario-8202894-project-member Apr 13 19:31:42 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:31:42 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:31:42 user devstack@n-api.service[61587]: X-User-Id: 9b9ed2da2b4949269c2df77766a1835f Apr 13 19:31:42 user devstack@n-api.service[61587]: X-User-Name: tempest-TestMinimumBasicScenario-8202894-project-member Apr 13 19:31:42 user devstack@n-api.service[61587]: method: > Apr 13 19:31:42 user devstack@n-api.service[61587]: exception: Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 is not attached to volume ec99b355-2456-4eef-af04-cc75aff66777 Apr 13 19:31:42 user devstack@n-api.service[61587]: action_args: {'server_id': '595c2a08-28fd-4076-b7bb-b9b0ac4349e6', 'id': 'ec99b355-2456-4eef-af04-cc75aff66777'} Apr 13 19:31:42 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ec99b355-2456-4eef-af04-cc75aff66777. Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 is not attached to volume ec99b355-2456-4eef-af04-cc75aff66777 Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 is not attached to volume ec99b355-2456-4eef-af04-cc75aff66777 Apr 13 19:31:42 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:31:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-3f8d904d-bf5b-444e-8514-ff4a5180e92f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Returning 404 to user: Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 is not attached to volume ec99b355-2456-4eef-af04-cc75aff66777 {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:31:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-3f8d904d-bf5b-444e-8514-ff4a5180e92f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/os-volume_attachments/ec99b355-2456-4eef-af04-cc75aff66777" status: 404 len: 154 microversion: 2.1 time: 0.117745 Apr 13 19:31:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 347/1032] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:31:42 2023] DELETE /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/os-volume_attachments/ec99b355-2456-4eef-af04-cc75aff66777 => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:31:44 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:31:44 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:31:44 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:31:44 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:31:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:44 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:31:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6" status: 204 len: 0 microversion: 2.1 time: 0.177419 Apr 13 19:31:44 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 343/1033] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:31:44 2023] DELETE /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:31:44 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-04aa5dd8-23db-4b8c-bb32-b52829e95b16 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:31:44 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-04aa5dd8-23db-4b8c-bb32-b52829e95b16 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:31:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-04aa5dd8-23db-4b8c-bb32-b52829e95b16 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-04aa5dd8-23db-4b8c-bb32-b52829e95b16 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-04aa5dd8-23db-4b8c-bb32-b52829e95b16 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-04aa5dd8-23db-4b8c-bb32-b52829e95b16 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-04aa5dd8-23db-4b8c-bb32-b52829e95b16 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:44 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-04aa5dd8-23db-4b8c-bb32-b52829e95b16 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:44 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-04aa5dd8-23db-4b8c-bb32-b52829e95b16 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:31:44 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-04aa5dd8-23db-4b8c-bb32-b52829e95b16 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6" status: 200 len: 1541 microversion: 2.1 time: 0.287019 Apr 13 19:31:44 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 344/1034] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:31:44 2023] GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => generated 1541 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 19:31:44 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-8b0b3b13-0509-4ccb-b9c2-04fa50445b2a req-e66cf807-34e6-4da3-91c0-352d79d74648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "name": "network-vif-unplugged", "status": "completed", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:31:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8b0b3b13-0509-4ccb-b9c2-04fa50445b2a req-e66cf807-34e6-4da3-91c0-352d79d74648 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8b0b3b13-0509-4ccb-b9c2-04fa50445b2a req-e66cf807-34e6-4da3-91c0-352d79d74648 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:44 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-8b0b3b13-0509-4ccb-b9c2-04fa50445b2a req-e66cf807-34e6-4da3-91c0-352d79d74648 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:44 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-8b0b3b13-0509-4ccb-b9c2-04fa50445b2a req-e66cf807-34e6-4da3-91c0-352d79d74648 service nova] Creating event network-vif-unplugged:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:31:44 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-8b0b3b13-0509-4ccb-b9c2-04fa50445b2a req-e66cf807-34e6-4da3-91c0-352d79d74648 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037292 Apr 13 19:31:44 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 348/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:31:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:31:45 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-7b0c02b7-a383-4377-aca2-c4068b335472 req-28cfcf93-5931-4714-b7e7-7584adbaedbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "name": "network-vif-deleted", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:31:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7b0c02b7-a383-4377-aca2-c4068b335472 req-28cfcf93-5931-4714-b7e7-7584adbaedbf service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7b0c02b7-a383-4377-aca2-c4068b335472 req-28cfcf93-5931-4714-b7e7-7584adbaedbf service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7b0c02b7-a383-4377-aca2-c4068b335472 req-28cfcf93-5931-4714-b7e7-7584adbaedbf service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:46 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-7b0c02b7-a383-4377-aca2-c4068b335472 req-28cfcf93-5931-4714-b7e7-7584adbaedbf service nova] Creating event network-vif-deleted:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:31:46 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-7b0c02b7-a383-4377-aca2-c4068b335472 req-28cfcf93-5931-4714-b7e7-7584adbaedbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034638 Apr 13 19:31:46 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 344/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:31:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:31:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-dee59bf8-ec0d-4665-b71f-c7e0ac5c5bac req-00e52353-7835-4528-974f-02f0b6ed8e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595c2a08-28fd-4076-b7bb-b9b0ac4349e6", "name": "network-vif-plugged", "status": "completed", "tag": "18d17551-39ea-401c-95cf-acfdafb210d5"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:31:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-dee59bf8-ec0d-4665-b71f-c7e0ac5c5bac req-00e52353-7835-4528-974f-02f0b6ed8e2a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:31:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-dee59bf8-ec0d-4665-b71f-c7e0ac5c5bac req-00e52353-7835-4528-974f-02f0b6ed8e2a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:31:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-dee59bf8-ec0d-4665-b71f-c7e0ac5c5bac req-00e52353-7835-4528-974f-02f0b6ed8e2a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:31:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-dee59bf8-ec0d-4665-b71f-c7e0ac5c5bac req-00e52353-7835-4528-974f-02f0b6ed8e2a service nova] Creating event network-vif-plugged:18d17551-39ea-401c-95cf-acfdafb210d5 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 on user Apr 13 19:31:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-dee59bf8-ec0d-4665-b71f-c7e0ac5c5bac req-00e52353-7835-4528-974f-02f0b6ed8e2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030970 Apr 13 19:31:47 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 345/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:31:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:32:00 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:00 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=8 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:00 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-208982332"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:32:00 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:32:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/action" status: 202 len: 52 microversion: 2.87 time: 1.019260 Apr 13 19:32:01 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 349/1038] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 19:32:00 2023] POST /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/action => generated 52 bytes in 1021 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-06753abd-d7dc-4c3a-9a34-1834c50967db tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-06753abd-d7dc-4c3a-9a34-1834c50967db tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-06753abd-d7dc-4c3a-9a34-1834c50967db tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-06753abd-d7dc-4c3a-9a34-1834c50967db tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-06753abd-d7dc-4c3a-9a34-1834c50967db tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-06753abd-d7dc-4c3a-9a34-1834c50967db tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-06753abd-d7dc-4c3a-9a34-1834c50967db tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-06753abd-d7dc-4c3a-9a34-1834c50967db tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-06753abd-d7dc-4c3a-9a34-1834c50967db tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-06753abd-d7dc-4c3a-9a34-1834c50967db tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:32:07 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-06753abd-d7dc-4c3a-9a34-1834c50967db tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:32:07 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-06753abd-d7dc-4c3a-9a34-1834c50967db tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" status: 200 len: 1690 microversion: 2.87 time: 0.238639 Apr 13 19:32:07 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 345/1039] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:32:07 2023] GET /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 => generated 1690 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:32:19 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:19 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=14 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:20 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-229cb812-69a8-419b-bce6-0513381f1b54 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:32:20 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-229cb812-69a8-419b-bce6-0513381f1b54 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:32:20 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-229cb812-69a8-419b-bce6-0513381f1b54 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:20 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-229cb812-69a8-419b-bce6-0513381f1b54 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:20 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-229cb812-69a8-419b-bce6-0513381f1b54 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:20 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-229cb812-69a8-419b-bce6-0513381f1b54 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:20 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-229cb812-69a8-419b-bce6-0513381f1b54 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:20 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-229cb812-69a8-419b-bce6-0513381f1b54 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:20 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-229cb812-69a8-419b-bce6-0513381f1b54 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:32:20 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-229cb812-69a8-419b-bce6-0513381f1b54 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800" status: 200 len: 1440 microversion: 2.1 time: 0.215427 Apr 13 19:32:20 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 346/1040] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:32:19 2023] GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800 => generated 1440 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:32:22 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:22 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:22 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbd7e115-1fc0-4c57-8ed8-eee343b69800", "tag": "78719f53-87de-44f2-b6f3-f2d77851fce0"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:32:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:22 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] Creating event network-changed:78719f53-87de-44f2-b6f3-f2d77851fce0 for instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 on user Apr 13 19:32:22 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043494 Apr 13 19:32:22 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 350/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:32:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:32:22 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:32:22 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:32:22 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:22 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:22 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:32:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800" status: 204 len: 0 microversion: 2.1 time: 0.123062 Apr 13 19:32:22 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 346/1042] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:32:22 2023] DELETE /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:32:22 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-af4e000d-cc6c-43f5-aec2-e53419b3c03f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:32:22 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-af4e000d-cc6c-43f5-aec2-e53419b3c03f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:32:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-af4e000d-cc6c-43f5-aec2-e53419b3c03f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-af4e000d-cc6c-43f5-aec2-e53419b3c03f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-af4e000d-cc6c-43f5-aec2-e53419b3c03f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-af4e000d-cc6c-43f5-aec2-e53419b3c03f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-af4e000d-cc6c-43f5-aec2-e53419b3c03f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-af4e000d-cc6c-43f5-aec2-e53419b3c03f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:22 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-af4e000d-cc6c-43f5-aec2-e53419b3c03f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:32:22 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-af4e000d-cc6c-43f5-aec2-e53419b3c03f tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800" status: 200 len: 1446 microversion: 2.1 time: 0.201801 Apr 13 19:32:22 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 347/1043] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:32:22 2023] GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800 => generated 1446 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 19:32:22 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-97090592-0130-45e0-934d-64d7dfe865a2 req-e0b50da8-e6b2-49b2-8c9d-622e6de7aba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd7e115-1fc0-4c57-8ed8-eee343b69800", "name": "network-vif-unplugged", "status": "completed", "tag": "78719f53-87de-44f2-b6f3-f2d77851fce0"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:32:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-97090592-0130-45e0-934d-64d7dfe865a2 req-e0b50da8-e6b2-49b2-8c9d-622e6de7aba4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-97090592-0130-45e0-934d-64d7dfe865a2 req-e0b50da8-e6b2-49b2-8c9d-622e6de7aba4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-97090592-0130-45e0-934d-64d7dfe865a2 req-e0b50da8-e6b2-49b2-8c9d-622e6de7aba4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:22 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-97090592-0130-45e0-934d-64d7dfe865a2 req-e0b50da8-e6b2-49b2-8c9d-622e6de7aba4 service nova] Creating event network-vif-unplugged:78719f53-87de-44f2-b6f3-f2d77851fce0 for instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 on user Apr 13 19:32:22 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-97090592-0130-45e0-934d-64d7dfe865a2 req-e0b50da8-e6b2-49b2-8c9d-622e6de7aba4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045451 Apr 13 19:32:22 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 351/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:32:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:32:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-99003ba5-276e-44f7-a48f-165a1ff6880f req-97476278-1b2d-4048-a895-e985a4a3682a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd7e115-1fc0-4c57-8ed8-eee343b69800", "name": "network-vif-deleted", "tag": "78719f53-87de-44f2-b6f3-f2d77851fce0"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:32:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-99003ba5-276e-44f7-a48f-165a1ff6880f req-97476278-1b2d-4048-a895-e985a4a3682a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-99003ba5-276e-44f7-a48f-165a1ff6880f req-97476278-1b2d-4048-a895-e985a4a3682a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-99003ba5-276e-44f7-a48f-165a1ff6880f req-97476278-1b2d-4048-a895-e985a4a3682a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-99003ba5-276e-44f7-a48f-165a1ff6880f req-97476278-1b2d-4048-a895-e985a4a3682a service nova] Creating event network-vif-deleted:78719f53-87de-44f2-b6f3-f2d77851fce0 for instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 on user Apr 13 19:32:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-99003ba5-276e-44f7-a48f-165a1ff6880f req-97476278-1b2d-4048-a895-e985a4a3682a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029696 Apr 13 19:32:24 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 347/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:32:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:32:24 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-193a9137-5f5c-48e2-b1c0-c9c2300f6986 req-c3c92013-5a61-4cc4-bd5f-20d0ea7e4455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd7e115-1fc0-4c57-8ed8-eee343b69800", "name": "network-vif-plugged", "status": "completed", "tag": "78719f53-87de-44f2-b6f3-f2d77851fce0"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:32:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-193a9137-5f5c-48e2-b1c0-c9c2300f6986 req-c3c92013-5a61-4cc4-bd5f-20d0ea7e4455 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-193a9137-5f5c-48e2-b1c0-c9c2300f6986 req-c3c92013-5a61-4cc4-bd5f-20d0ea7e4455 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-193a9137-5f5c-48e2-b1c0-c9c2300f6986 req-c3c92013-5a61-4cc4-bd5f-20d0ea7e4455 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-193a9137-5f5c-48e2-b1c0-c9c2300f6986 req-c3c92013-5a61-4cc4-bd5f-20d0ea7e4455 service nova] Creating event network-vif-plugged:78719f53-87de-44f2-b6f3-f2d77851fce0 for instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 on user Apr 13 19:32:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-193a9137-5f5c-48e2-b1c0-c9c2300f6986 req-c3c92013-5a61-4cc4-bd5f-20d0ea7e4455 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036203 Apr 13 19:32:24 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 348/1046] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:32:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:32:34 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:34 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-392b605b-4dd0-4da1-ad7f-5b74107f2a49 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:32:34 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-392b605b-4dd0-4da1-ad7f-5b74107f2a49 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:32:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-392b605b-4dd0-4da1-ad7f-5b74107f2a49 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-392b605b-4dd0-4da1-ad7f-5b74107f2a49 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-392b605b-4dd0-4da1-ad7f-5b74107f2a49 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-392b605b-4dd0-4da1-ad7f-5b74107f2a49 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-392b605b-4dd0-4da1-ad7f-5b74107f2a49 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-392b605b-4dd0-4da1-ad7f-5b74107f2a49 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:34 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-392b605b-4dd0-4da1-ad7f-5b74107f2a49 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] HTTP exception thrown: Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 could not be found. Apr 13 19:32:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-392b605b-4dd0-4da1-ad7f-5b74107f2a49 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Request method failure captured: Apr 13 19:32:34 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6 HTTP/1.1 Apr 13 19:32:34 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:32:34 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:32:34 user devstack@n-api.service[61587]: Connection: close Apr 13 19:32:34 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:32:34 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:32:34 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:32:34 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:32:34 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFdvUUNU3CyZfYq8lEiyknYArK8nkfrpiGCt9b8fTam0ipMnKPXUwxym-ZMuQE95pg5AM-XyAxuWw_Iwfsc0moQXJ1PD_km4KJ5j8ysffj-w-BZzcryYhn-EGsEISGrf0aVCPD-1rJmkvNHdmqgf35ImrndabMYEfBojUzhyScvCiUw Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Project-Id: ba0e42217cc44413951d6d5a87dbb886 Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Project-Name: tempest-TestMinimumBasicScenario-8202894 Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba0e42217cc44413951d6d5a87dbb886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ba0e42217cc44413951d6d5a87dbb886"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba0e42217cc44413951d6d5a87dbb886"}]}] Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Tenant: tempest-TestMinimumBasicScenario-8202894 Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Tenant-Id: ba0e42217cc44413951d6d5a87dbb886 Apr 13 19:32:34 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-TestMinimumBasicScenario-8202894 Apr 13 19:32:34 user devstack@n-api.service[61587]: X-User: tempest-TestMinimumBasicScenario-8202894-project-member Apr 13 19:32:34 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:32:34 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:32:34 user devstack@n-api.service[61587]: X-User-Id: 9b9ed2da2b4949269c2df77766a1835f Apr 13 19:32:34 user devstack@n-api.service[61587]: X-User-Name: tempest-TestMinimumBasicScenario-8202894-project-member Apr 13 19:32:34 user devstack@n-api.service[61587]: method: > Apr 13 19:32:34 user devstack@n-api.service[61587]: exception: Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 could not be found. Apr 13 19:32:34 user devstack@n-api.service[61587]: action_args: {'id': '595c2a08-28fd-4076-b7bb-b9b0ac4349e6'} Apr 13 19:32:34 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 could not be found. Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 could not be found. Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:32:34 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:32:35 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:32:35 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:32:35 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:32:35 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 could not be found. Apr 13 19:32:35 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:32:35 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-392b605b-4dd0-4da1-ad7f-5b74107f2a49 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Returning 404 to user: Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:32:35 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-392b605b-4dd0-4da1-ad7f-5b74107f2a49 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6" status: 404 len: 111 microversion: 2.1 time: 0.031878 Apr 13 19:32:35 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 352/1047] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:32:34 2023] GET /compute/v2.1/servers/595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:32:35 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:35 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:35 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-462946cd-9bf5-49b4-b5a0-b9cb39f90d06 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '.version_select at 0x7efe33fab1c0>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:32:35 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-462946cd-9bf5-49b4-b5a0-b9cb39f90d06 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-256533708" status: 202 len: 0 microversion: 2.1 time: 0.028173 Apr 13 19:32:35 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 348/1048] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 13 19:32:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-256533708 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:32:37 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:37 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=14 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:32:37 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9148b647-d683-45da-a536-2c83f7032c67 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Action: 'create', calling method: .version_select at 0x7efe33c23400>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-717246144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwcqpuDDwnFCEHILsu3WkKfw+2MVJkUkNLRq/o7hP6qLuVniwQ8/8OV7G92m5CXMJVOwwdyf9OuSgpmCn7j4zLzXlUPSwq2Fys9p4c7O5dwLlZB/zevuX8VkzU1GXk55A=="}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:32:37 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-9148b647-d683-45da-a536-2c83f7032c67 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting quotas for project ba0e42217cc44413951d6d5a87dbb886. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:32:37 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-9148b647-d683-45da-a536-2c83f7032c67 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting quotas for user 9b9ed2da2b4949269c2df77766a1835f and project ba0e42217cc44413951d6d5a87dbb886. Resources: {'key_pairs'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:32:37 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-9148b647-d683-45da-a536-2c83f7032c67 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.072671 Apr 13 19:32:37 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 349/1049] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 19:32:37 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1642739098", "imageRef": "757ffc78-56f8-4b5c-b83d-33fa99678d59", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-717246144", "networks": [{"uuid": "2b40b836-544b-4e28-9672-0a59d4b98271"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] validate_networks() for [('2b40b836-544b-4e28-9672-0a59d4b98271', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting quotas for project ba0e42217cc44413951d6d5a87dbb886. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting quotas for user 9b9ed2da2b4949269c2df77766a1835f and project ba0e42217cc44413951d6d5a87dbb886. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:32:37 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='757ffc78-56f8-4b5c-b83d-33fa99678d59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:32:37 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.519365 Apr 13 19:32:37 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 353/1050] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:32:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:32:37 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-15612ea6-ccac-4464-ac01-6aa781571da4 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:32:37 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-15612ea6-ccac-4464-ac01-6aa781571da4 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:32:37 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-15612ea6-ccac-4464-ac01-6aa781571da4 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:32:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-15612ea6-ccac-4464-ac01-6aa781571da4 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070" status: 200 len: 1252 microversion: 2.1 time: 0.094957 Apr 13 19:32:37 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 349/1051] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:32:37 2023] GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070 => generated 1252 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:32:40 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:32:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:40 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:40 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] Creating event network-changed:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:32:40 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035451 Apr 13 19:32:40 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 350/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:32:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:32:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-5b6dc080-d80d-4bab-b147-f0b1014bca8c req-cc32f9ba-fd39-46e0-99ff-bede2cc7b467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "name": "network-vif-plugged", "status": "completed", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:32:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5b6dc080-d80d-4bab-b147-f0b1014bca8c req-cc32f9ba-fd39-46e0-99ff-bede2cc7b467 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5b6dc080-d80d-4bab-b147-f0b1014bca8c req-cc32f9ba-fd39-46e0-99ff-bede2cc7b467 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-5b6dc080-d80d-4bab-b147-f0b1014bca8c req-cc32f9ba-fd39-46e0-99ff-bede2cc7b467 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-5b6dc080-d80d-4bab-b147-f0b1014bca8c req-cc32f9ba-fd39-46e0-99ff-bede2cc7b467 service nova] Creating event network-vif-plugged:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:32:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-5b6dc080-d80d-4bab-b147-f0b1014bca8c req-cc32f9ba-fd39-46e0-99ff-bede2cc7b467 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031450 Apr 13 19:32:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 354/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:32:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:32:44 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-e573d677-381b-4b31-853d-3c63b051dff2 req-05a4551f-9694-4b19-8ceb-55565a736ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "name": "network-vif-plugged", "status": "completed", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:32:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e573d677-381b-4b31-853d-3c63b051dff2 req-05a4551f-9694-4b19-8ceb-55565a736ee8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:32:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e573d677-381b-4b31-853d-3c63b051dff2 req-05a4551f-9694-4b19-8ceb-55565a736ee8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:32:44 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-e573d677-381b-4b31-853d-3c63b051dff2 req-05a4551f-9694-4b19-8ceb-55565a736ee8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:32:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-e573d677-381b-4b31-853d-3c63b051dff2 req-05a4551f-9694-4b19-8ceb-55565a736ee8 service nova] Creating event network-vif-plugged:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:32:44 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-e573d677-381b-4b31-853d-3c63b051dff2 req-05a4551f-9694-4b19-8ceb-55565a736ee8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033664 Apr 13 19:32:44 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 350/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:32:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:33:07 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:07 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:07 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:07 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-613518771", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "destination_type": "volume"}], "networks": [{"uuid": "09341996-8218-4461-9635-d3f9187c1d42"}]}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:33:07 user devstack@n-api.service[61589]: DEBUG nova.network.neutron [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] validate_networks() for [('09341996-8218-4461-9635-d3f9187c1d42', None, None, None, None, None)] {{(pid=61589) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image limits 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image pref 0:0:0 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting quotas for project c00a7fcd6d3040e8b2db0448eeda93ad. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG nova.quota [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting quotas for user dd604fa4d17b42b1abea8c2f2405b58d and project c00a7fcd6d3040e8b2db0448eeda93ad. Resources: {'cores', 'ram', 'instances'} {{(pid=61589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Going to run 1 instances... {{(pid=61589) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:33:08 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:33:08 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.679723 Apr 13 19:33:08 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 351/1055] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 19:33:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 19:33:08 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-80478939-e631-45e7-a03a-48de65bef455 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:33:08 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-80478939-e631-45e7-a03a-48de65bef455 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:33:08 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:08 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:08 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:08 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:08 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-80478939-e631-45e7-a03a-48de65bef455 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:33:08 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-80478939-e631-45e7-a03a-48de65bef455 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:33:08 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-80478939-e631-45e7-a03a-48de65bef455 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:33:08 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-80478939-e631-45e7-a03a-48de65bef455 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" status: 200 len: 1394 microversion: 2.87 time: 0.155525 Apr 13 19:33:08 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 355/1056] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:33:08 2023] GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => generated 1394 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:33:10 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:10 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:10 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:10 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:33:10 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:10 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:10 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:10 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] Creating event network-changed:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:33:10 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037288 Apr 13 19:33:10 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 351/1057] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:33:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:33:12 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-4d91c5df-202f-4690-acc4-b1cd201972f9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:33:12 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-4d91c5df-202f-4690-acc4-b1cd201972f9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:33:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4d91c5df-202f-4690-acc4-b1cd201972f9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4d91c5df-202f-4690-acc4-b1cd201972f9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4d91c5df-202f-4690-acc4-b1cd201972f9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4d91c5df-202f-4690-acc4-b1cd201972f9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4d91c5df-202f-4690-acc4-b1cd201972f9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:12 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4d91c5df-202f-4690-acc4-b1cd201972f9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-4d91c5df-202f-4690-acc4-b1cd201972f9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:33:12 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-4d91c5df-202f-4690-acc4-b1cd201972f9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:33:12 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800 HTTP/1.1 Apr 13 19:33:12 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:33:12 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:33:12 user devstack@n-api.service[61589]: Connection: close Apr 13 19:33:12 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:33:12 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:33:12 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:33:12 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:33:12 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:33:12 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:33:12 user devstack@n-api.service[61589]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:33:12 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:33:12 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:33:12 user devstack@n-api.service[61589]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:33:12 user devstack@n-api.service[61589]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:33:12 user devstack@n-api.service[61589]: method: > Apr 13 19:33:12 user devstack@n-api.service[61589]: exception: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:33:12 user devstack@n-api.service[61589]: action_args: {'id': 'bbd7e115-1fc0-4c57-8ed8-eee343b69800'} Apr 13 19:33:12 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:33:12 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:33:12 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-4d91c5df-202f-4690-acc4-b1cd201972f9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:33:12 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-4d91c5df-202f-4690-acc4-b1cd201972f9 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800" status: 404 len: 111 microversion: 2.1 time: 0.035268 Apr 13 19:33:12 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 352/1058] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:33:12 2023] GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:33:12 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1195708667", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1410205426", "security_groups": [{"name": "tempest-secgroup-smoke-892708207"}], "block_device_mapping_v2": [{"uuid": "859d56a6-4c86-402c-9b6c-564c027c53d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "824b1924-526b-40ac-95d3-6927aa9656c4"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:33:12 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] validate_networks() for [('824b1924-526b-40ac-95d3-6927aa9656c4', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for project a5231d999e51417ebe91927707bfd2bd. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for user 526d9c809b81418d89da662f973a1bdc and project a5231d999e51417ebe91927707bfd2bd. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:33:13 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='859d56a6-4c86-402c-9b6c-564c027c53d5',volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:33:13 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.790708 Apr 13 19:33:13 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 356/1059] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:33:12 2023] POST /compute/v2.1/servers => generated 403 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:33:13 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0dad2b2a-42a9-4b40-8b2f-b76ae4db0908 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:33:13 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-0dad2b2a-42a9-4b40-8b2f-b76ae4db0908 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:33:13 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-0dad2b2a-42a9-4b40-8b2f-b76ae4db0908 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:33:13 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-0dad2b2a-42a9-4b40-8b2f-b76ae4db0908 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" status: 200 len: 1090 microversion: 2.1 time: 0.063151 Apr 13 19:33:13 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 352/1060] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:33:13 2023] GET /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c => generated 1090 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:33:16 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c", "tag": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:33:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:16 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] Creating event network-changed:35ecb629-90f6-4af1-b1fa-042bfb0cba8d for instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c on user Apr 13 19:33:16 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030118 Apr 13 19:33:16 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 353/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:33:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:33:22 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-669ba22b-1412-4976-96ca-a41fbf36b4ab req-e8744157-8300-4c4a-8da4-240e66739324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-plugged", "status": "completed", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:33:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-669ba22b-1412-4976-96ca-a41fbf36b4ab req-e8744157-8300-4c4a-8da4-240e66739324 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-669ba22b-1412-4976-96ca-a41fbf36b4ab req-e8744157-8300-4c4a-8da4-240e66739324 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-669ba22b-1412-4976-96ca-a41fbf36b4ab req-e8744157-8300-4c4a-8da4-240e66739324 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:22 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-669ba22b-1412-4976-96ca-a41fbf36b4ab req-e8744157-8300-4c4a-8da4-240e66739324 service nova] Creating event network-vif-plugged:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:33:22 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-669ba22b-1412-4976-96ca-a41fbf36b4ab req-e8744157-8300-4c4a-8da4-240e66739324 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081224 Apr 13 19:33:22 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 357/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:33:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:33:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-plugged", "status": "completed", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}, {"server_uuid": "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c", "name": "network-vif-plugged", "status": "completed", "tag": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d"}, {"server_uuid": "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c", "name": "network-vif-plugged", "status": "completed", "tag": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:33:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:24 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Creating event network-vif-plugged:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:33:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Creating event network-vif-plugged:35ecb629-90f6-4af1-b1fa-042bfb0cba8d for instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c on user Apr 13 19:33:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Creating event network-vif-plugged:35ecb629-90f6-4af1-b1fa-042bfb0cba8d for instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c on user Apr 13 19:33:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046356 Apr 13 19:33:24 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 353/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:33:24 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:33:27 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:27 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:27 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:27 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:27 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-421b9bb2-a846-4cff-a6e6-bb812592e321 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:33:27 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-421b9bb2-a846-4cff-a6e6-bb812592e321 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:33:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-421b9bb2-a846-4cff-a6e6-bb812592e321 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-421b9bb2-a846-4cff-a6e6-bb812592e321 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-421b9bb2-a846-4cff-a6e6-bb812592e321 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-421b9bb2-a846-4cff-a6e6-bb812592e321 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-421b9bb2-a846-4cff-a6e6-bb812592e321 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-421b9bb2-a846-4cff-a6e6-bb812592e321 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:28 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-421b9bb2-a846-4cff-a6e6-bb812592e321 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:33:28 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-421b9bb2-a846-4cff-a6e6-bb812592e321 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070" status: 200 len: 1535 microversion: 2.1 time: 0.175567 Apr 13 19:33:28 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 354/1064] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:33:27 2023] GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070 => generated 1535 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=8 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-54ed926a-0644-40cd-b1fb-b9f7d722ab09 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-54ed926a-0644-40cd-b1fb-b9f7d722ab09 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-54ed926a-0644-40cd-b1fb-b9f7d722ab09 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-54ed926a-0644-40cd-b1fb-b9f7d722ab09 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-54ed926a-0644-40cd-b1fb-b9f7d722ab09 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-54ed926a-0644-40cd-b1fb-b9f7d722ab09 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-54ed926a-0644-40cd-b1fb-b9f7d722ab09 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-54ed926a-0644-40cd-b1fb-b9f7d722ab09 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-54ed926a-0644-40cd-b1fb-b9f7d722ab09 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-54ed926a-0644-40cd-b1fb-b9f7d722ab09 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:33:58 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-54ed926a-0644-40cd-b1fb-b9f7d722ab09 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:33:58 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-54ed926a-0644-40cd-b1fb-b9f7d722ab09 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" status: 200 len: 1768 microversion: 2.87 time: 0.184028 Apr 13 19:33:58 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 358/1065] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:33:58 2023] GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => generated 1768 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:34:03 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:03 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:03 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a2a595ad-dfc5-47e3-994c-07acc5763db0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:34:03 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-a2a595ad-dfc5-47e3-994c-07acc5763db0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:34:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a2a595ad-dfc5-47e3-994c-07acc5763db0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a2a595ad-dfc5-47e3-994c-07acc5763db0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a2a595ad-dfc5-47e3-994c-07acc5763db0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a2a595ad-dfc5-47e3-994c-07acc5763db0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a2a595ad-dfc5-47e3-994c-07acc5763db0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a2a595ad-dfc5-47e3-994c-07acc5763db0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:03 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-a2a595ad-dfc5-47e3-994c-07acc5763db0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:34:03 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-a2a595ad-dfc5-47e3-994c-07acc5763db0 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" status: 200 len: 1441 microversion: 2.1 time: 0.243191 Apr 13 19:34:03 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 354/1066] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:34:03 2023] GET /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c => generated 1441 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:34:28 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:28 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:28 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d36eaecc-a531-4ee5-980c-ec3e22cc7654 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:34:28 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-d36eaecc-a531-4ee5-980c-ec3e22cc7654 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:34:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d36eaecc-a531-4ee5-980c-ec3e22cc7654 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d36eaecc-a531-4ee5-980c-ec3e22cc7654 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d36eaecc-a531-4ee5-980c-ec3e22cc7654 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d36eaecc-a531-4ee5-980c-ec3e22cc7654 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d36eaecc-a531-4ee5-980c-ec3e22cc7654 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:28 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d36eaecc-a531-4ee5-980c-ec3e22cc7654 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:28 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-d36eaecc-a531-4ee5-980c-ec3e22cc7654 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:34:28 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d36eaecc-a531-4ee5-980c-ec3e22cc7654 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070" status: 200 len: 1535 microversion: 2.1 time: 0.167089 Apr 13 19:34:28 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 355/1067] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:34:28 2023] GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070 => generated 1535 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:34:28 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-4174a10b-c2c9-4d22-bef5-690dc3cd982f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:34:28 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-4174a10b-c2c9-4d22-bef5-690dc3cd982f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:34:28 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-4174a10b-c2c9-4d22-bef5-690dc3cd982f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Searching by: {'deleted': False, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886'} {{(pid=61587) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 19:34:28 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:28 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4174a10b-c2c9-4d22-bef5-690dc3cd982f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4174a10b-c2c9-4d22-bef5-690dc3cd982f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4174a10b-c2c9-4d22-bef5-690dc3cd982f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4174a10b-c2c9-4d22-bef5-690dc3cd982f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4174a10b-c2c9-4d22-bef5-690dc3cd982f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:28 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-4174a10b-c2c9-4d22-bef5-690dc3cd982f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:28 user devstack@n-api.service[61587]: DEBUG nova.compute.multi_cell_list [None req-4174a10b-c2c9-4d22-bef5-690dc3cd982f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 19:34:28 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-4174a10b-c2c9-4d22-bef5-690dc3cd982f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.167451 Apr 13 19:34:28 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 359/1068] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 19:34:28 2023] GET /compute/v2.1/servers => generated 341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:34:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e877cae5-9576-48cc-bff5-e642637eb955 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:34:28 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e877cae5-9576-48cc-bff5-e642637eb955 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:34:28 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:28 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e877cae5-9576-48cc-bff5-e642637eb955 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e877cae5-9576-48cc-bff5-e642637eb955 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e877cae5-9576-48cc-bff5-e642637eb955 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e877cae5-9576-48cc-bff5-e642637eb955 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e877cae5-9576-48cc-bff5-e642637eb955 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e877cae5-9576-48cc-bff5-e642637eb955 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:28 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-e877cae5-9576-48cc-bff5-e642637eb955 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:34:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e877cae5-9576-48cc-bff5-e642637eb955 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070" status: 200 len: 1535 microversion: 2.1 time: 0.147871 Apr 13 19:34:28 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 355/1069] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:34:28 2023] GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070 => generated 1535 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:34:30 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:34:30 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:34:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:30 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "POST /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319299 Apr 13 19:34:30 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 356/1070] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 19:34:30 2023] POST /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:34:38 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-26f90b3e-5c1f-4c45-9538-976a73dbcc3f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:34:38 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-26f90b3e-5c1f-4c45-9538-976a73dbcc3f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:34:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-26f90b3e-5c1f-4c45-9538-976a73dbcc3f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-26f90b3e-5c1f-4c45-9538-976a73dbcc3f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-26f90b3e-5c1f-4c45-9538-976a73dbcc3f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-26f90b3e-5c1f-4c45-9538-976a73dbcc3f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-26f90b3e-5c1f-4c45-9538-976a73dbcc3f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:38 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-26f90b3e-5c1f-4c45-9538-976a73dbcc3f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:38 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-26f90b3e-5c1f-4c45-9538-976a73dbcc3f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:34:38 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-26f90b3e-5c1f-4c45-9538-976a73dbcc3f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070" status: 200 len: 1581 microversion: 2.1 time: 0.153004 Apr 13 19:34:38 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 360/1071] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:34:38 2023] GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070 => generated 1581 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:34:40 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:34:40 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:40 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] Creating event network-changed:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:34:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031137 Apr 13 19:34:40 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 356/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:34:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:34:41 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:41 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:41 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-afa3ed0f-e0be-4c87-92b7-c6f41cd79c42 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-231154399"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:34:41 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-afa3ed0f-e0be-4c87-92b7-c6f41cd79c42 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:34:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-afa3ed0f-e0be-4c87-92b7-c6f41cd79c42 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-afa3ed0f-e0be-4c87-92b7-c6f41cd79c42 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-afa3ed0f-e0be-4c87-92b7-c6f41cd79c42 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-afa3ed0f-e0be-4c87-92b7-c6f41cd79c42 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-afa3ed0f-e0be-4c87-92b7-c6f41cd79c42 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-afa3ed0f-e0be-4c87-92b7-c6f41cd79c42 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:41 user devstack@n-api.service[61589]: INFO nova.network.security_group_api [None req-afa3ed0f-e0be-4c87-92b7-c6f41cd79c42 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Adding security group 59514171-a06a-4910-ba40-d1a6757d67c8 to port c940609d-fa89-4382-ad90-bba2f3f551f3 Apr 13 19:34:42 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-afa3ed0f-e0be-4c87-92b7-c6f41cd79c42 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "POST /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/action" status: 202 len: 0 microversion: 2.1 time: 0.925915 Apr 13 19:34:42 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 357/1073] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:34:41 2023] POST /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/action => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:42 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-b87d8e01-1658-45de-9bf3-169e0890ec79 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:34:42 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-b87d8e01-1658-45de-9bf3-169e0890ec79 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:34:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b87d8e01-1658-45de-9bf3-169e0890ec79 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b87d8e01-1658-45de-9bf3-169e0890ec79 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b87d8e01-1658-45de-9bf3-169e0890ec79 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b87d8e01-1658-45de-9bf3-169e0890ec79 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b87d8e01-1658-45de-9bf3-169e0890ec79 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:42 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b87d8e01-1658-45de-9bf3-169e0890ec79 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] Creating event network-changed:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:34:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077977 Apr 13 19:34:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 361/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:34:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:34:42 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-b87d8e01-1658-45de-9bf3-169e0890ec79 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:34:42 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-b87d8e01-1658-45de-9bf3-169e0890ec79 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070" status: 200 len: 1745 microversion: 2.1 time: 0.166018 Apr 13 19:34:42 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 357/1075] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:34:42 2023] GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:34:42 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:34:42 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:34:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:42 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:42 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "POST /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/action" status: 202 len: 0 microversion: 2.1 time: 0.087161 Apr 13 19:34:42 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 358/1076] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:34:42 2023] POST /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-62172a04-55a1-4b38-b3c0-10d7f26ddc87 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-62172a04-55a1-4b38-b3c0-10d7f26ddc87 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-62172a04-55a1-4b38-b3c0-10d7f26ddc87 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-62172a04-55a1-4b38-b3c0-10d7f26ddc87 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-62172a04-55a1-4b38-b3c0-10d7f26ddc87 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-62172a04-55a1-4b38-b3c0-10d7f26ddc87 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-62172a04-55a1-4b38-b3c0-10d7f26ddc87 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-62172a04-55a1-4b38-b3c0-10d7f26ddc87 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:42 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-62172a04-55a1-4b38-b3c0-10d7f26ddc87 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:34:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-62172a04-55a1-4b38-b3c0-10d7f26ddc87 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070" status: 200 len: 1737 microversion: 2.1 time: 0.176691 Apr 13 19:34:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 362/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:34:42 2023] GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:34:45 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-7d3d65ad-9e5f-410d-96d2-ce27873805f5 req-c13742b9-3edb-43f3-8c3f-1fd1be7c0c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "name": "network-vif-unplugged", "status": "completed", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:34:45 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7d3d65ad-9e5f-410d-96d2-ce27873805f5 req-c13742b9-3edb-43f3-8c3f-1fd1be7c0c70 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:45 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7d3d65ad-9e5f-410d-96d2-ce27873805f5 req-c13742b9-3edb-43f3-8c3f-1fd1be7c0c70 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:45 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-7d3d65ad-9e5f-410d-96d2-ce27873805f5 req-c13742b9-3edb-43f3-8c3f-1fd1be7c0c70 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:45 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-7d3d65ad-9e5f-410d-96d2-ce27873805f5 req-c13742b9-3edb-43f3-8c3f-1fd1be7c0c70 service nova] Creating event network-vif-unplugged:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:34:45 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-7d3d65ad-9e5f-410d-96d2-ce27873805f5 req-c13742b9-3edb-43f3-8c3f-1fd1be7c0c70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031913 Apr 13 19:34:45 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 358/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:34:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:34:47 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-aebfa13f-665f-4a99-b336-4d336da109cf req-5f4bdd26-72dc-4a5d-9459-89d47d9ba04b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "name": "network-vif-plugged", "status": "completed", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:34:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-aebfa13f-665f-4a99-b336-4d336da109cf req-5f4bdd26-72dc-4a5d-9459-89d47d9ba04b service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-aebfa13f-665f-4a99-b336-4d336da109cf req-5f4bdd26-72dc-4a5d-9459-89d47d9ba04b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:47 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-aebfa13f-665f-4a99-b336-4d336da109cf req-5f4bdd26-72dc-4a5d-9459-89d47d9ba04b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-aebfa13f-665f-4a99-b336-4d336da109cf req-5f4bdd26-72dc-4a5d-9459-89d47d9ba04b service nova] Creating event network-vif-plugged:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:34:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-aebfa13f-665f-4a99-b336-4d336da109cf req-5f4bdd26-72dc-4a5d-9459-89d47d9ba04b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030171 Apr 13 19:34:47 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 359/1079] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:34:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:34:49 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "name": "network-vif-plugged", "status": "completed", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}, {"server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "name": "network-vif-plugged", "status": "completed", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:34:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:49 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] Creating event network-vif-plugged:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:34:49 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] Creating event network-vif-plugged:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:34:49 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037426 Apr 13 19:34:49 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 363/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:34:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:34:58 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:58 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=10 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:58 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "067fd318-fa29-4977-bde7-099e19c05db4"}} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:34:58 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:34:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:58 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:58 user devstack@n-api.service[61588]: DEBUG nova.objects.instance [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'flavor' on Instance uuid f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 {{(pid=61588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:34:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/action" status: 200 len: 29 microversion: 2.87 time: 0.477681 Apr 13 19:34:59 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 359/1081] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 19:34:58 2023] POST /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/action => generated 29 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-4974783b-fafb-498a-bda7-734dcc72dbdf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-4974783b-fafb-498a-bda7-734dcc72dbdf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4974783b-fafb-498a-bda7-734dcc72dbdf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4974783b-fafb-498a-bda7-734dcc72dbdf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4974783b-fafb-498a-bda7-734dcc72dbdf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4974783b-fafb-498a-bda7-734dcc72dbdf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4974783b-fafb-498a-bda7-734dcc72dbdf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-4974783b-fafb-498a-bda7-734dcc72dbdf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-4974783b-fafb-498a-bda7-734dcc72dbdf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-4974783b-fafb-498a-bda7-734dcc72dbdf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:34:59 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-4974783b-fafb-498a-bda7-734dcc72dbdf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:34:59 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-4974783b-fafb-498a-bda7-734dcc72dbdf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" status: 200 len: 1774 microversion: 2.87 time: 0.192142 Apr 13 19:34:59 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 360/1082] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:34:59 2023] GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => generated 1774 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:35:00 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-90d4f9aa-9610-4473-896e-3710105589f0 req-90b3eda5-6190-44d5-b3d9-8348b6de6e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-unplugged", "status": "completed", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:35:00 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=10 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:35:00 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=24 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:35:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-90d4f9aa-9610-4473-896e-3710105589f0 req-90b3eda5-6190-44d5-b3d9-8348b6de6e55 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-90d4f9aa-9610-4473-896e-3710105589f0 req-90b3eda5-6190-44d5-b3d9-8348b6de6e55 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:00 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-90d4f9aa-9610-4473-896e-3710105589f0 req-90b3eda5-6190-44d5-b3d9-8348b6de6e55 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:00 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-90d4f9aa-9610-4473-896e-3710105589f0 req-90b3eda5-6190-44d5-b3d9-8348b6de6e55 service nova] Creating event network-vif-unplugged:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:35:00 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-90d4f9aa-9610-4473-896e-3710105589f0 req-90b3eda5-6190-44d5-b3d9-8348b6de6e55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036282 Apr 13 19:35:00 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 364/1083] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:35:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:35:02 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-a8a27766-a6b6-4890-8994-e6dc986beaa8 req-d77c6873-1f41-403a-b773-e12fee8fbbdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-plugged", "status": "completed", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:35:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-a8a27766-a6b6-4890-8994-e6dc986beaa8 req-d77c6873-1f41-403a-b773-e12fee8fbbdb service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-a8a27766-a6b6-4890-8994-e6dc986beaa8 req-d77c6873-1f41-403a-b773-e12fee8fbbdb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:02 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-a8a27766-a6b6-4890-8994-e6dc986beaa8 req-d77c6873-1f41-403a-b773-e12fee8fbbdb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-a8a27766-a6b6-4890-8994-e6dc986beaa8 req-d77c6873-1f41-403a-b773-e12fee8fbbdb service nova] Creating event network-vif-plugged:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:35:02 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-a8a27766-a6b6-4890-8994-e6dc986beaa8 req-d77c6873-1f41-403a-b773-e12fee8fbbdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037436 Apr 13 19:35:02 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 360/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:35:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:35:03 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-45216ca5-0557-4830-b345-e6fdcffddb0c tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:35:03 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-45216ca5-0557-4830-b345-e6fdcffddb0c tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:35:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-45216ca5-0557-4830-b345-e6fdcffddb0c tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-45216ca5-0557-4830-b345-e6fdcffddb0c tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-45216ca5-0557-4830-b345-e6fdcffddb0c tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-45216ca5-0557-4830-b345-e6fdcffddb0c tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-45216ca5-0557-4830-b345-e6fdcffddb0c tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-45216ca5-0557-4830-b345-e6fdcffddb0c tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:04 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-45216ca5-0557-4830-b345-e6fdcffddb0c tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:35:04 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-45216ca5-0557-4830-b345-e6fdcffddb0c tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" status: 200 len: 1441 microversion: 2.1 time: 0.165943 Apr 13 19:35:04 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 361/1085] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:35:03 2023] GET /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c => generated 1441 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:35:04 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-4fe4b912-75f4-4a93-aed7-eb385283f9bd req-5efcc3da-2275-46cc-ad2c-7e42734eb0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-plugged", "status": "completed", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:35:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4fe4b912-75f4-4a93-aed7-eb385283f9bd req-5efcc3da-2275-46cc-ad2c-7e42734eb0e9 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4fe4b912-75f4-4a93-aed7-eb385283f9bd req-5efcc3da-2275-46cc-ad2c-7e42734eb0e9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-4fe4b912-75f4-4a93-aed7-eb385283f9bd req-5efcc3da-2275-46cc-ad2c-7e42734eb0e9 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:04 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-4fe4b912-75f4-4a93-aed7-eb385283f9bd req-5efcc3da-2275-46cc-ad2c-7e42734eb0e9 service nova] Creating event network-vif-plugged:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:35:04 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-4fe4b912-75f4-4a93-aed7-eb385283f9bd req-5efcc3da-2275-46cc-ad2c-7e42734eb0e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053471 Apr 13 19:35:04 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 365/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:35:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:35:05 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c", "tag": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:35:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:05 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] Creating event network-changed:35ecb629-90f6-4af1-b1fa-042bfb0cba8d for instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c on user Apr 13 19:35:05 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075842 Apr 13 19:35:05 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 361/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:35:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:35:06 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-7a199c7d-66e2-468e-9a63-cb1e880961c6 req-5377bd95-73e9-4826-89e2-fcc344e786a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-plugged", "status": "completed", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:35:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7a199c7d-66e2-468e-9a63-cb1e880961c6 req-5377bd95-73e9-4826-89e2-fcc344e786a4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7a199c7d-66e2-468e-9a63-cb1e880961c6 req-5377bd95-73e9-4826-89e2-fcc344e786a4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:06 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7a199c7d-66e2-468e-9a63-cb1e880961c6 req-5377bd95-73e9-4826-89e2-fcc344e786a4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:06 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-7a199c7d-66e2-468e-9a63-cb1e880961c6 req-5377bd95-73e9-4826-89e2-fcc344e786a4 service nova] Creating event network-vif-plugged:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:35:06 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-7a199c7d-66e2-468e-9a63-cb1e880961c6 req-5377bd95-73e9-4826-89e2-fcc344e786a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030772 Apr 13 19:35:06 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 362/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:35:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:35:10 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1007669840", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1410205426", "security_groups": [{"name": "tempest-secgroup-smoke-892708207"}], "block_device_mapping_v2": [{"uuid": "11e49275-fcba-44ff-a89f-406f93351219", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "824b1924-526b-40ac-95d3-6927aa9656c4"}]}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:35:10 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] validate_networks() for [('824b1924-526b-40ac-95d3-6927aa9656c4', None, None, None, None, None)] {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for project a5231d999e51417ebe91927707bfd2bd. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting quotas for user 526d9c809b81418d89da662f973a1bdc and project a5231d999e51417ebe91927707bfd2bd. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:35:11 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11e49275-fcba-44ff-a89f-406f93351219',volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:35:11 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.932379 Apr 13 19:35:11 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 366/1089] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:35:10 2023] POST /compute/v2.1/servers => generated 403 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:35:11 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-dd1663ed-4741-42b2-bb02-f12843677243 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:35:11 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-dd1663ed-4741-42b2-bb02-f12843677243 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:35:11 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-dd1663ed-4741-42b2-bb02-f12843677243 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:35:11 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-dd1663ed-4741-42b2-bb02-f12843677243 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f" status: 200 len: 1090 microversion: 2.1 time: 0.074712 Apr 13 19:35:11 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 362/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:35:11 2023] GET /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f => generated 1090 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:35:13 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e331ffd-2171-44b4-a367-559a334ab52f", "tag": "784e464c-9f0c-4e58-af49-905cf5ad0e31"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:35:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:14 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:14 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] Creating event network-changed:784e464c-9f0c-4e58-af49-905cf5ad0e31 for instance 7e331ffd-2171-44b4-a367-559a334ab52f on user Apr 13 19:35:14 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035113 Apr 13 19:35:14 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 363/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:35:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:35:20 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-c779511f-e722-46fe-83a8-c2d1cb232a76 req-678653bf-835b-45c3-910b-027ad279bdd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e331ffd-2171-44b4-a367-559a334ab52f", "name": "network-vif-plugged", "status": "completed", "tag": "784e464c-9f0c-4e58-af49-905cf5ad0e31"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:35:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-c779511f-e722-46fe-83a8-c2d1cb232a76 req-678653bf-835b-45c3-910b-027ad279bdd1 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-c779511f-e722-46fe-83a8-c2d1cb232a76 req-678653bf-835b-45c3-910b-027ad279bdd1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:20 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-c779511f-e722-46fe-83a8-c2d1cb232a76 req-678653bf-835b-45c3-910b-027ad279bdd1 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:20 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-c779511f-e722-46fe-83a8-c2d1cb232a76 req-678653bf-835b-45c3-910b-027ad279bdd1 service nova] Creating event network-vif-plugged:784e464c-9f0c-4e58-af49-905cf5ad0e31 for instance 7e331ffd-2171-44b4-a367-559a334ab52f on user Apr 13 19:35:20 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-c779511f-e722-46fe-83a8-c2d1cb232a76 req-678653bf-835b-45c3-910b-027ad279bdd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080562 Apr 13 19:35:20 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 367/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:35:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:35:22 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-02fa37d1-fbfa-4aa3-a0e8-5e3d2beec136 req-5b54c2c2-bf13-4404-ba1e-1828bfc7e424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e331ffd-2171-44b4-a367-559a334ab52f", "name": "network-vif-plugged", "status": "completed", "tag": "784e464c-9f0c-4e58-af49-905cf5ad0e31"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:35:22 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:35:22 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=10 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:35:22 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell0:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:35:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-02fa37d1-fbfa-4aa3-a0e8-5e3d2beec136 req-5b54c2c2-bf13-4404-ba1e-1828bfc7e424 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-02fa37d1-fbfa-4aa3-a0e8-5e3d2beec136 req-5b54c2c2-bf13-4404-ba1e-1828bfc7e424 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-02fa37d1-fbfa-4aa3-a0e8-5e3d2beec136 req-5b54c2c2-bf13-4404-ba1e-1828bfc7e424 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-02fa37d1-fbfa-4aa3-a0e8-5e3d2beec136 req-5b54c2c2-bf13-4404-ba1e-1828bfc7e424 service nova] Creating event network-vif-plugged:784e464c-9f0c-4e58-af49-905cf5ad0e31 for instance 7e331ffd-2171-44b4-a367-559a334ab52f on user Apr 13 19:35:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-02fa37d1-fbfa-4aa3-a0e8-5e3d2beec136 req-5b54c2c2-bf13-4404-ba1e-1828bfc7e424 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041349 Apr 13 19:35:22 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 363/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:35:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:35:32 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=10 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:35:32 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=16 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:35:32 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-dae4b499-c2bc-439f-913e-ebf7618d774c tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:35:32 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-dae4b499-c2bc-439f-913e-ebf7618d774c tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:35:32 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dae4b499-c2bc-439f-913e-ebf7618d774c tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:32 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dae4b499-c2bc-439f-913e-ebf7618d774c tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:32 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dae4b499-c2bc-439f-913e-ebf7618d774c tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:32 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dae4b499-c2bc-439f-913e-ebf7618d774c tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:32 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dae4b499-c2bc-439f-913e-ebf7618d774c tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:32 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dae4b499-c2bc-439f-913e-ebf7618d774c tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:33 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-dae4b499-c2bc-439f-913e-ebf7618d774c tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:35:33 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-dae4b499-c2bc-439f-913e-ebf7618d774c tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070" status: 200 len: 1745 microversion: 2.1 time: 0.176071 Apr 13 19:35:33 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 364/1094] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:35:32 2023] GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-1a2c0e3e-b573-4e9c-bb1f-0520f1a9f6dc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-1a2c0e3e-b573-4e9c-bb1f-0520f1a9f6dc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=8 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1a2c0e3e-b573-4e9c-bb1f-0520f1a9f6dc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1a2c0e3e-b573-4e9c-bb1f-0520f1a9f6dc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1a2c0e3e-b573-4e9c-bb1f-0520f1a9f6dc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1a2c0e3e-b573-4e9c-bb1f-0520f1a9f6dc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1a2c0e3e-b573-4e9c-bb1f-0520f1a9f6dc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-1a2c0e3e-b573-4e9c-bb1f-0520f1a9f6dc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-1a2c0e3e-b573-4e9c-bb1f-0520f1a9f6dc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-1a2c0e3e-b573-4e9c-bb1f-0520f1a9f6dc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:35:49 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-1a2c0e3e-b573-4e9c-bb1f-0520f1a9f6dc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:35:49 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-1a2c0e3e-b573-4e9c-bb1f-0520f1a9f6dc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" status: 200 len: 1754 microversion: 2.87 time: 0.171803 Apr 13 19:35:49 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 368/1095] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:35:49 2023] GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:36:01 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-48b19e8c-703a-4a9f-a013-89d00dd99871 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:36:01 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-48b19e8c-703a-4a9f-a013-89d00dd99871 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:36:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-48b19e8c-703a-4a9f-a013-89d00dd99871 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-48b19e8c-703a-4a9f-a013-89d00dd99871 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-48b19e8c-703a-4a9f-a013-89d00dd99871 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-48b19e8c-703a-4a9f-a013-89d00dd99871 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-48b19e8c-703a-4a9f-a013-89d00dd99871 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-48b19e8c-703a-4a9f-a013-89d00dd99871 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:01 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-48b19e8c-703a-4a9f-a013-89d00dd99871 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:36:01 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-48b19e8c-703a-4a9f-a013-89d00dd99871 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f" status: 200 len: 1442 microversion: 2.1 time: 0.158425 Apr 13 19:36:01 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 364/1096] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:36:01 2023] GET /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:36:33 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:33 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:33 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-2360b3a6-8dd8-46b8-beb8-5e87260c44d0 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-231154399"}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:36:33 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-2360b3a6-8dd8-46b8-beb8-5e87260c44d0 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:36:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2360b3a6-8dd8-46b8-beb8-5e87260c44d0 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2360b3a6-8dd8-46b8-beb8-5e87260c44d0 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2360b3a6-8dd8-46b8-beb8-5e87260c44d0 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2360b3a6-8dd8-46b8-beb8-5e87260c44d0 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2360b3a6-8dd8-46b8-beb8-5e87260c44d0 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:33 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-2360b3a6-8dd8-46b8-beb8-5e87260c44d0 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:33 user devstack@n-api.service[61589]: INFO nova.network.security_group_api [None req-2360b3a6-8dd8-46b8-beb8-5e87260c44d0 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Removing security group 59514171-a06a-4910-ba40-d1a6757d67c8 from port c940609d-fa89-4382-ad90-bba2f3f551f3 Apr 13 19:36:33 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-2360b3a6-8dd8-46b8-beb8-5e87260c44d0 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "POST /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/action" status: 202 len: 0 microversion: 2.1 time: 0.593761 Apr 13 19:36:33 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 365/1097] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 19:36:33 2023] POST /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 19:36:33 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:36:33 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:33 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:33 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] Creating event network-changed:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:36:33 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038690 Apr 13 19:36:33 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 369/1098] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:36:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:36:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:36:34 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:36:34 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:34 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=8 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:34 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:36:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:34 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] Creating event network-changed:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:36:34 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032036 Apr 13 19:36:34 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 366/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:36:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:36:34 user devstack@n-api.service[61588]: DEBUG nova.objects.instance [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'services' on Instance uuid 86893da2-3681-4a37-a6fc-1f56a2682070 {{(pid=61588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 19:36:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/os-volume_attachments/c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d" status: 202 len: 0 microversion: 2.1 time: 0.185387 Apr 13 19:36:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 365/1100] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:36:34 2023] DELETE /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/os-volume_attachments/c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:36:34 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-49dda1fc-340d-4963-9b9f-5a2def38e2e6 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:36:34 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-49dda1fc-340d-4963-9b9f-5a2def38e2e6 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:36:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-49dda1fc-340d-4963-9b9f-5a2def38e2e6 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-49dda1fc-340d-4963-9b9f-5a2def38e2e6 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-49dda1fc-340d-4963-9b9f-5a2def38e2e6 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-49dda1fc-340d-4963-9b9f-5a2def38e2e6 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-49dda1fc-340d-4963-9b9f-5a2def38e2e6 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:34 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-49dda1fc-340d-4963-9b9f-5a2def38e2e6 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:34 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-49dda1fc-340d-4963-9b9f-5a2def38e2e6 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057606 Apr 13 19:36:34 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 370/1101] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:36:34 2023] GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:36:49 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:36:49 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:36:49 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:49 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/action" status: 202 len: 0 microversion: 2.87 time: 0.079894 Apr 13 19:36:49 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 367/1102] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 19:36:49 2023] POST /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:36:49 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:49 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:49 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-abf35376-cd14-4ad5-be16-7d93d73c20cf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:36:49 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-abf35376-cd14-4ad5-be16-7d93d73c20cf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:36:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-abf35376-cd14-4ad5-be16-7d93d73c20cf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-abf35376-cd14-4ad5-be16-7d93d73c20cf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-abf35376-cd14-4ad5-be16-7d93d73c20cf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-abf35376-cd14-4ad5-be16-7d93d73c20cf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-abf35376-cd14-4ad5-be16-7d93d73c20cf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:49 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-abf35376-cd14-4ad5-be16-7d93d73c20cf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:50 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-abf35376-cd14-4ad5-be16-7d93d73c20cf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:36:50 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-abf35376-cd14-4ad5-be16-7d93d73c20cf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:36:50 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-abf35376-cd14-4ad5-be16-7d93d73c20cf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:36:50 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-abf35376-cd14-4ad5-be16-7d93d73c20cf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" status: 200 len: 1762 microversion: 2.87 time: 0.164285 Apr 13 19:36:50 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 366/1103] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:36:49 2023] GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => generated 1762 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:36:50 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-73501aaa-0401-4a68-bc63-2071b984a799 req-bb30953f-b8c3-46f3-8752-8c0776416d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-unplugged", "status": "completed", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:36:50 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:50 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=8 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:36:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-73501aaa-0401-4a68-bc63-2071b984a799 req-bb30953f-b8c3-46f3-8752-8c0776416d6f service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-73501aaa-0401-4a68-bc63-2071b984a799 req-bb30953f-b8c3-46f3-8752-8c0776416d6f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-73501aaa-0401-4a68-bc63-2071b984a799 req-bb30953f-b8c3-46f3-8752-8c0776416d6f service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:50 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-73501aaa-0401-4a68-bc63-2071b984a799 req-bb30953f-b8c3-46f3-8752-8c0776416d6f service nova] Creating event network-vif-unplugged:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:36:50 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-73501aaa-0401-4a68-bc63-2071b984a799 req-bb30953f-b8c3-46f3-8752-8c0776416d6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043101 Apr 13 19:36:50 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 371/1104] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:36:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:36:53 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-plugged", "status": "completed", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}, {"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-plugged", "status": "completed", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}, {"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-plugged", "status": "completed", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:36:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:36:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:36:53 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:36:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Creating event network-vif-plugged:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:36:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Creating event network-vif-plugged:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:36:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Creating event network-vif-plugged:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:36:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034917 Apr 13 19:36:53 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 368/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:36:53 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:37:01 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-e4b3e345-70b4-4ead-b345-c95942e63d42 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:37:01 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-e4b3e345-70b4-4ead-b345-c95942e63d42 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:37:01 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:01 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e4b3e345-70b4-4ead-b345-c95942e63d42 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e4b3e345-70b4-4ead-b345-c95942e63d42 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e4b3e345-70b4-4ead-b345-c95942e63d42 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e4b3e345-70b4-4ead-b345-c95942e63d42 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e4b3e345-70b4-4ead-b345-c95942e63d42 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:01 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-e4b3e345-70b4-4ead-b345-c95942e63d42 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:01 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-e4b3e345-70b4-4ead-b345-c95942e63d42 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:37:01 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-e4b3e345-70b4-4ead-b345-c95942e63d42 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f" status: 200 len: 1442 microversion: 2.1 time: 0.171484 Apr 13 19:37:01 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 367/1106] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:37:01 2023] GET /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f => generated 1442 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:37:03 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:03 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:03 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e331ffd-2171-44b4-a367-559a334ab52f", "tag": "784e464c-9f0c-4e58-af49-905cf5ad0e31"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:37:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:03 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] Creating event network-changed:784e464c-9f0c-4e58-af49-905cf5ad0e31 for instance 7e331ffd-2171-44b4-a367-559a334ab52f on user Apr 13 19:37:03 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043346 Apr 13 19:37:03 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 372/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:37:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:37:04 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:04 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:04 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:37:04 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:37:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:04 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:04 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Going to try to terminate instance {{(pid=61589) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:37:04 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f" status: 204 len: 0 microversion: 2.1 time: 0.122646 Apr 13 19:37:04 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 369/1108] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:37:04 2023] DELETE /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:37:04 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4a4ed5a7-801a-4e84-b741-98dff7be892b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:37:04 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-4a4ed5a7-801a-4e84-b741-98dff7be892b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:37:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4a4ed5a7-801a-4e84-b741-98dff7be892b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4a4ed5a7-801a-4e84-b741-98dff7be892b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4a4ed5a7-801a-4e84-b741-98dff7be892b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4a4ed5a7-801a-4e84-b741-98dff7be892b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4a4ed5a7-801a-4e84-b741-98dff7be892b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:04 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4a4ed5a7-801a-4e84-b741-98dff7be892b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:04 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-4a4ed5a7-801a-4e84-b741-98dff7be892b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:37:04 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-4a4ed5a7-801a-4e84-b741-98dff7be892b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f" status: 200 len: 1567 microversion: 2.1 time: 0.159956 Apr 13 19:37:04 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 368/1109] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:37:04 2023] GET /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:37:04 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-13866f21-6e4b-414f-bd27-f9395f67ca10 req-dbb601f2-ff51-4520-a046-bc3484ea796b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e331ffd-2171-44b4-a367-559a334ab52f", "name": "network-vif-unplugged", "status": "completed", "tag": "784e464c-9f0c-4e58-af49-905cf5ad0e31"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:37:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-13866f21-6e4b-414f-bd27-f9395f67ca10 req-dbb601f2-ff51-4520-a046-bc3484ea796b service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-13866f21-6e4b-414f-bd27-f9395f67ca10 req-dbb601f2-ff51-4520-a046-bc3484ea796b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:04 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-13866f21-6e4b-414f-bd27-f9395f67ca10 req-dbb601f2-ff51-4520-a046-bc3484ea796b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:04 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-13866f21-6e4b-414f-bd27-f9395f67ca10 req-dbb601f2-ff51-4520-a046-bc3484ea796b service nova] Creating event network-vif-unplugged:784e464c-9f0c-4e58-af49-905cf5ad0e31 for instance 7e331ffd-2171-44b4-a367-559a334ab52f on user Apr 13 19:37:04 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-13866f21-6e4b-414f-bd27-f9395f67ca10 req-dbb601f2-ff51-4520-a046-bc3484ea796b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035122 Apr 13 19:37:04 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 373/1110] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:37:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:37:05 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e331ffd-2171-44b4-a367-559a334ab52f", "tag": "784e464c-9f0c-4e58-af49-905cf5ad0e31"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:37:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:05 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:05 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] Creating event network-changed:784e464c-9f0c-4e58-af49-905cf5ad0e31 for instance 7e331ffd-2171-44b4-a367-559a334ab52f on user Apr 13 19:37:05 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036274 Apr 13 19:37:05 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 370/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:37:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:37:06 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-0ef52671-c721-45bb-8097-aa89c7b769d1 req-8698acf4-af20-497a-938e-68a12e616307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e331ffd-2171-44b4-a367-559a334ab52f", "name": "network-vif-plugged", "status": "completed", "tag": "784e464c-9f0c-4e58-af49-905cf5ad0e31"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:37:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0ef52671-c721-45bb-8097-aa89c7b769d1 req-8698acf4-af20-497a-938e-68a12e616307 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0ef52671-c721-45bb-8097-aa89c7b769d1 req-8698acf4-af20-497a-938e-68a12e616307 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:06 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-0ef52671-c721-45bb-8097-aa89c7b769d1 req-8698acf4-af20-497a-938e-68a12e616307 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:06 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-0ef52671-c721-45bb-8097-aa89c7b769d1 req-8698acf4-af20-497a-938e-68a12e616307 service nova] Creating event network-vif-plugged:784e464c-9f0c-4e58-af49-905cf5ad0e31 for instance 7e331ffd-2171-44b4-a367-559a334ab52f on user Apr 13 19:37:06 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-0ef52671-c721-45bb-8097-aa89c7b769d1 req-8698acf4-af20-497a-938e-68a12e616307 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034985 Apr 13 19:37:06 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 369/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:37:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 19:37:08 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-2292a825-5cba-4099-96d0-18e023e4e70c req-fa6f4fdf-72d4-4059-a2a4-8b3dd052cf77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e331ffd-2171-44b4-a367-559a334ab52f", "name": "network-vif-deleted", "tag": "784e464c-9f0c-4e58-af49-905cf5ad0e31"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:37:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2292a825-5cba-4099-96d0-18e023e4e70c req-fa6f4fdf-72d4-4059-a2a4-8b3dd052cf77 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2292a825-5cba-4099-96d0-18e023e4e70c req-fa6f4fdf-72d4-4059-a2a4-8b3dd052cf77 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:08 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-2292a825-5cba-4099-96d0-18e023e4e70c req-fa6f4fdf-72d4-4059-a2a4-8b3dd052cf77 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:08 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-2292a825-5cba-4099-96d0-18e023e4e70c req-fa6f4fdf-72d4-4059-a2a4-8b3dd052cf77 service nova] Creating event network-vif-deleted:784e464c-9f0c-4e58-af49-905cf5ad0e31 for instance 7e331ffd-2171-44b4-a367-559a334ab52f on user Apr 13 19:37:08 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-2292a825-5cba-4099-96d0-18e023e4e70c req-fa6f4fdf-72d4-4059-a2a4-8b3dd052cf77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028960 Apr 13 19:37:08 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 374/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:37:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:37:24 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:24 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:25 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8878abdf-326a-4c0b-ad55-cf99a2cf0088 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:37:25 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-8878abdf-326a-4c0b-ad55-cf99a2cf0088 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:37:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8878abdf-326a-4c0b-ad55-cf99a2cf0088 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8878abdf-326a-4c0b-ad55-cf99a2cf0088 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8878abdf-326a-4c0b-ad55-cf99a2cf0088 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8878abdf-326a-4c0b-ad55-cf99a2cf0088 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8878abdf-326a-4c0b-ad55-cf99a2cf0088 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:25 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8878abdf-326a-4c0b-ad55-cf99a2cf0088 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:25 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-8878abdf-326a-4c0b-ad55-cf99a2cf0088 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.309702 Apr 13 19:37:25 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 371/1114] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 19:37:24 2023] GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/os-volume_attachments => generated 25 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 19:37:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-18692b88-7f04-4c34-9452-71241a67a6e9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:37:25 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-18692b88-7f04-4c34-9452-71241a67a6e9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:37:25 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:25 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=14 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-18692b88-7f04-4c34-9452-71241a67a6e9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-18692b88-7f04-4c34-9452-71241a67a6e9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-18692b88-7f04-4c34-9452-71241a67a6e9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-18692b88-7f04-4c34-9452-71241a67a6e9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-18692b88-7f04-4c34-9452-71241a67a6e9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:25 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-18692b88-7f04-4c34-9452-71241a67a6e9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-18692b88-7f04-4c34-9452-71241a67a6e9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] HTTP exception thrown: Instance 86893da2-3681-4a37-a6fc-1f56a2682070 is not attached to volume c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d Apr 13 19:37:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-18692b88-7f04-4c34-9452-71241a67a6e9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Request method failure captured: Apr 13 19:37:25 user devstack@n-api.service[61588]: request: DELETE /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/os-volume_attachments/c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d HTTP/1.1 Apr 13 19:37:25 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:37:25 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:37:25 user devstack@n-api.service[61588]: Connection: close Apr 13 19:37:25 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:37:25 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:37:25 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:37:25 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:37:25 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFdvUUNU3CyZfYq8lEiyknYArK8nkfrpiGCt9b8fTam0ipMnKPXUwxym-ZMuQE95pg5AM-XyAxuWw_Iwfsc0moQXJ1PD_km4KJ5j8ysffj-w-BZzcryYhn-EGsEISGrf0aVCPD-1rJmkvNHdmqgf35ImrndabMYEfBojUzhyScvCiUw Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Project-Id: ba0e42217cc44413951d6d5a87dbb886 Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Project-Name: tempest-TestMinimumBasicScenario-8202894 Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba0e42217cc44413951d6d5a87dbb886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ba0e42217cc44413951d6d5a87dbb886"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba0e42217cc44413951d6d5a87dbb886"}]}] Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Tenant: tempest-TestMinimumBasicScenario-8202894 Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Tenant-Id: ba0e42217cc44413951d6d5a87dbb886 Apr 13 19:37:25 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TestMinimumBasicScenario-8202894 Apr 13 19:37:25 user devstack@n-api.service[61588]: X-User: tempest-TestMinimumBasicScenario-8202894-project-member Apr 13 19:37:25 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:37:25 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:37:25 user devstack@n-api.service[61588]: X-User-Id: 9b9ed2da2b4949269c2df77766a1835f Apr 13 19:37:25 user devstack@n-api.service[61588]: X-User-Name: tempest-TestMinimumBasicScenario-8202894-project-member Apr 13 19:37:25 user devstack@n-api.service[61588]: method: > Apr 13 19:37:25 user devstack@n-api.service[61588]: exception: Instance 86893da2-3681-4a37-a6fc-1f56a2682070 is not attached to volume c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d Apr 13 19:37:25 user devstack@n-api.service[61588]: action_args: {'server_id': '86893da2-3681-4a37-a6fc-1f56a2682070', 'id': 'c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d'} Apr 13 19:37:25 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d. Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86893da2-3681-4a37-a6fc-1f56a2682070 is not attached to volume c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86893da2-3681-4a37-a6fc-1f56a2682070 is not attached to volume c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d Apr 13 19:37:25 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:37:25 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-18692b88-7f04-4c34-9452-71241a67a6e9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Returning 404 to user: Instance 86893da2-3681-4a37-a6fc-1f56a2682070 is not attached to volume c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:37:25 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-18692b88-7f04-4c34-9452-71241a67a6e9 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/os-volume_attachments/c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d" status: 404 len: 154 microversion: 2.1 time: 0.100230 Apr 13 19:37:25 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 370/1115] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 19:37:25 2023] DELETE /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070/os-volume_attachments/c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:37:27 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:27 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:27 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:37:27 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:37:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:27 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:27 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:37:27 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070" status: 204 len: 0 microversion: 2.1 time: 0.140364 Apr 13 19:37:27 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 375/1116] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:37:27 2023] DELETE /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:37:27 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-58e12e97-3099-4639-9b1c-71db0ae97020 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:37:27 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-58e12e97-3099-4639-9b1c-71db0ae97020 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:37:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-58e12e97-3099-4639-9b1c-71db0ae97020 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-58e12e97-3099-4639-9b1c-71db0ae97020 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-58e12e97-3099-4639-9b1c-71db0ae97020 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-58e12e97-3099-4639-9b1c-71db0ae97020 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-58e12e97-3099-4639-9b1c-71db0ae97020 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:27 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-58e12e97-3099-4639-9b1c-71db0ae97020 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:27 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-58e12e97-3099-4639-9b1c-71db0ae97020 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:37:27 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-58e12e97-3099-4639-9b1c-71db0ae97020 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070" status: 200 len: 1541 microversion: 2.1 time: 0.204960 Apr 13 19:37:27 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 372/1117] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:37:27 2023] GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070 => generated 1541 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:37:28 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-9b1a68f7-ffaf-40b5-9485-a3f4673ff053 req-5df5cd8b-7d7a-48d2-8fea-7fce04c88239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "name": "network-vif-unplugged", "status": "completed", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:37:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-9b1a68f7-ffaf-40b5-9485-a3f4673ff053 req-5df5cd8b-7d7a-48d2-8fea-7fce04c88239 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-9b1a68f7-ffaf-40b5-9485-a3f4673ff053 req-5df5cd8b-7d7a-48d2-8fea-7fce04c88239 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:28 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-9b1a68f7-ffaf-40b5-9485-a3f4673ff053 req-5df5cd8b-7d7a-48d2-8fea-7fce04c88239 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-9b1a68f7-ffaf-40b5-9485-a3f4673ff053 req-5df5cd8b-7d7a-48d2-8fea-7fce04c88239 service nova] Creating event network-vif-unplugged:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:37:28 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-9b1a68f7-ffaf-40b5-9485-a3f4673ff053 req-5df5cd8b-7d7a-48d2-8fea-7fce04c88239 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036754 Apr 13 19:37:28 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 371/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:37:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:37:29 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-7d505442-e045-46e0-95b4-0805ecc39733 req-5e5733f9-09a8-498f-bd12-4062d70575d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "name": "network-vif-deleted", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:37:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-7d505442-e045-46e0-95b4-0805ecc39733 req-5e5733f9-09a8-498f-bd12-4062d70575d4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-7d505442-e045-46e0-95b4-0805ecc39733 req-5e5733f9-09a8-498f-bd12-4062d70575d4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:29 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-7d505442-e045-46e0-95b4-0805ecc39733 req-5e5733f9-09a8-498f-bd12-4062d70575d4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:29 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-7d505442-e045-46e0-95b4-0805ecc39733 req-5e5733f9-09a8-498f-bd12-4062d70575d4 service nova] Creating event network-vif-deleted:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:37:29 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-7d505442-e045-46e0-95b4-0805ecc39733 req-5e5733f9-09a8-498f-bd12-4062d70575d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028977 Apr 13 19:37:29 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 376/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:37:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:37:30 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-939c6ae5-b4b8-4273-be14-22b0cc2cc55a req-523a60ac-f850-496a-932f-8d7cfcd15453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86893da2-3681-4a37-a6fc-1f56a2682070", "name": "network-vif-plugged", "status": "completed", "tag": "c940609d-fa89-4382-ad90-bba2f3f551f3"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:37:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-939c6ae5-b4b8-4273-be14-22b0cc2cc55a req-523a60ac-f850-496a-932f-8d7cfcd15453 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-939c6ae5-b4b8-4273-be14-22b0cc2cc55a req-523a60ac-f850-496a-932f-8d7cfcd15453 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:30 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-939c6ae5-b4b8-4273-be14-22b0cc2cc55a req-523a60ac-f850-496a-932f-8d7cfcd15453 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:30 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-939c6ae5-b4b8-4273-be14-22b0cc2cc55a req-523a60ac-f850-496a-932f-8d7cfcd15453 service nova] Creating event network-vif-plugged:c940609d-fa89-4382-ad90-bba2f3f551f3 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 on user Apr 13 19:37:30 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-939c6ae5-b4b8-4273-be14-22b0cc2cc55a req-523a60ac-f850-496a-932f-8d7cfcd15453 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028483 Apr 13 19:37:30 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 373/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:37:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=8 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-ac6169b2-c8cd-4669-9b61-d31972f40e1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-ac6169b2-c8cd-4669-9b61-d31972f40e1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ac6169b2-c8cd-4669-9b61-d31972f40e1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ac6169b2-c8cd-4669-9b61-d31972f40e1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ac6169b2-c8cd-4669-9b61-d31972f40e1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ac6169b2-c8cd-4669-9b61-d31972f40e1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ac6169b2-c8cd-4669-9b61-d31972f40e1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-ac6169b2-c8cd-4669-9b61-d31972f40e1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-ac6169b2-c8cd-4669-9b61-d31972f40e1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-ac6169b2-c8cd-4669-9b61-d31972f40e1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:37:40 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-ac6169b2-c8cd-4669-9b61-d31972f40e1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:37:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-ac6169b2-c8cd-4669-9b61-d31972f40e1c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" status: 200 len: 1768 microversion: 2.87 time: 0.155370 Apr 13 19:37:40 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 372/1121] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:37:40 2023] GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => generated 1768 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:37:54 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:54 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:54 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c0853428-4dae-4ea3-b575-fe18e2180acf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:37:54 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-c0853428-4dae-4ea3-b575-fe18e2180acf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:37:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c0853428-4dae-4ea3-b575-fe18e2180acf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c0853428-4dae-4ea3-b575-fe18e2180acf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c0853428-4dae-4ea3-b575-fe18e2180acf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c0853428-4dae-4ea3-b575-fe18e2180acf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c0853428-4dae-4ea3-b575-fe18e2180acf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:54 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-c0853428-4dae-4ea3-b575-fe18e2180acf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:54 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-c0853428-4dae-4ea3-b575-fe18e2180acf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance 7e331ffd-2171-44b4-a367-559a334ab52f could not be found. Apr 13 19:37:54 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c0853428-4dae-4ea3-b575-fe18e2180acf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:37:54 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f HTTP/1.1 Apr 13 19:37:54 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:37:54 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:37:54 user devstack@n-api.service[61587]: Connection: close Apr 13 19:37:54 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:37:54 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:37:54 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:37:54 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:37:54 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:37:54 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:37:54 user devstack@n-api.service[61587]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:37:54 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:37:54 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:37:54 user devstack@n-api.service[61587]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:37:54 user devstack@n-api.service[61587]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:37:54 user devstack@n-api.service[61587]: method: > Apr 13 19:37:54 user devstack@n-api.service[61587]: exception: Instance 7e331ffd-2171-44b4-a367-559a334ab52f could not be found. Apr 13 19:37:54 user devstack@n-api.service[61587]: action_args: {'id': '7e331ffd-2171-44b4-a367-559a334ab52f'} Apr 13 19:37:54 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e331ffd-2171-44b4-a367-559a334ab52f could not be found. Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e331ffd-2171-44b4-a367-559a334ab52f could not be found. Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e331ffd-2171-44b4-a367-559a334ab52f could not be found. Apr 13 19:37:54 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:37:54 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-c0853428-4dae-4ea3-b575-fe18e2180acf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance 7e331ffd-2171-44b4-a367-559a334ab52f could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:37:54 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-c0853428-4dae-4ea3-b575-fe18e2180acf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f" status: 404 len: 111 microversion: 2.1 time: 0.230620 Apr 13 19:37:54 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 377/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:37:54 2023] GET /compute/v2.1/servers/7e331ffd-2171-44b4-a367-559a334ab52f => generated 111 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:37:59 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:59 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=14 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:59 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:37:59 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:37:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:59 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:59 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c", "tag": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:37:59 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:59 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:37:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:59 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Going to try to terminate instance {{(pid=61589) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:37:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] Creating event network-changed:35ecb629-90f6-4af1-b1fa-042bfb0cba8d for instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c on user Apr 13 19:37:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034624 Apr 13 19:37:59 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 373/1123] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:37:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:37:59 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" status: 204 len: 0 microversion: 2.1 time: 0.123570 Apr 13 19:37:59 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 374/1124] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:37:59 2023] DELETE /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:37:59 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-28b3317a-426e-4ff4-9468-88fbef46e20a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:37:59 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-28b3317a-426e-4ff4-9468-88fbef46e20a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:37:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-28b3317a-426e-4ff4-9468-88fbef46e20a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-28b3317a-426e-4ff4-9468-88fbef46e20a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-28b3317a-426e-4ff4-9468-88fbef46e20a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:37:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-28b3317a-426e-4ff4-9468-88fbef46e20a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:37:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-28b3317a-426e-4ff4-9468-88fbef46e20a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:37:59 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-28b3317a-426e-4ff4-9468-88fbef46e20a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:00 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-ed7d717b-66aa-40e9-be60-350181ce068e req-52fd7d3a-c0d4-4e58-9207-a10a5ca315d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c", "name": "network-vif-unplugged", "status": "completed", "tag": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:38:00 user devstack@n-api.service[61587]: DEBUG nova.policy [None req-28b3317a-426e-4ff4-9468-88fbef46e20a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61587) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:38:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ed7d717b-66aa-40e9-be60-350181ce068e req-52fd7d3a-c0d4-4e58-9207-a10a5ca315d4 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:00 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-28b3317a-426e-4ff4-9468-88fbef46e20a tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" status: 200 len: 1566 microversion: 2.1 time: 0.273359 Apr 13 19:38:00 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 378/1125] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:37:59 2023] GET /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c => generated 1566 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:38:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ed7d717b-66aa-40e9-be60-350181ce068e req-52fd7d3a-c0d4-4e58-9207-a10a5ca315d4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:00 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-ed7d717b-66aa-40e9-be60-350181ce068e req-52fd7d3a-c0d4-4e58-9207-a10a5ca315d4 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:00 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-ed7d717b-66aa-40e9-be60-350181ce068e req-52fd7d3a-c0d4-4e58-9207-a10a5ca315d4 service nova] Creating event network-vif-unplugged:35ecb629-90f6-4af1-b1fa-042bfb0cba8d for instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c on user Apr 13 19:38:00 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-ed7d717b-66aa-40e9-be60-350181ce068e req-52fd7d3a-c0d4-4e58-9207-a10a5ca315d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031510 Apr 13 19:38:00 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 374/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:38:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:38:01 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-a3b418d9-a35c-4a2d-90ab-3e60d72cadc8 req-49a0b374-1b84-4c1d-ae0b-8893f67b6daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c", "name": "network-vif-deleted", "tag": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:38:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a3b418d9-a35c-4a2d-90ab-3e60d72cadc8 req-49a0b374-1b84-4c1d-ae0b-8893f67b6daf service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a3b418d9-a35c-4a2d-90ab-3e60d72cadc8 req-49a0b374-1b84-4c1d-ae0b-8893f67b6daf service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:01 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-a3b418d9-a35c-4a2d-90ab-3e60d72cadc8 req-49a0b374-1b84-4c1d-ae0b-8893f67b6daf service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:01 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-a3b418d9-a35c-4a2d-90ab-3e60d72cadc8 req-49a0b374-1b84-4c1d-ae0b-8893f67b6daf service nova] Creating event network-vif-deleted:35ecb629-90f6-4af1-b1fa-042bfb0cba8d for instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c on user Apr 13 19:38:01 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-a3b418d9-a35c-4a2d-90ab-3e60d72cadc8 req-49a0b374-1b84-4c1d-ae0b-8893f67b6daf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029843 Apr 13 19:38:01 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 375/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:38:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:38:02 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-3716acc1-a472-478f-87b4-76f131c18447 req-3a77dcca-ae47-4b7c-accd-f6d893a51e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c", "name": "network-vif-plugged", "status": "completed", "tag": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:38:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-3716acc1-a472-478f-87b4-76f131c18447 req-3a77dcca-ae47-4b7c-accd-f6d893a51e7a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-3716acc1-a472-478f-87b4-76f131c18447 req-3a77dcca-ae47-4b7c-accd-f6d893a51e7a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:02 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-3716acc1-a472-478f-87b4-76f131c18447 req-3a77dcca-ae47-4b7c-accd-f6d893a51e7a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:02 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-3716acc1-a472-478f-87b4-76f131c18447 req-3a77dcca-ae47-4b7c-accd-f6d893a51e7a service nova] Creating event network-vif-plugged:35ecb629-90f6-4af1-b1fa-042bfb0cba8d for instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c on user Apr 13 19:38:02 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-3716acc1-a472-478f-87b4-76f131c18447 req-3a77dcca-ae47-4b7c-accd-f6d893a51e7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034973 Apr 13 19:38:02 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 379/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:38:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:38:18 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:38:18 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:38:18 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-203b3783-3604-4274-b96a-f1784f0bdcaf tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:38:18 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-203b3783-3604-4274-b96a-f1784f0bdcaf tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:38:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-203b3783-3604-4274-b96a-f1784f0bdcaf tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-203b3783-3604-4274-b96a-f1784f0bdcaf tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-203b3783-3604-4274-b96a-f1784f0bdcaf tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-203b3783-3604-4274-b96a-f1784f0bdcaf tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-203b3783-3604-4274-b96a-f1784f0bdcaf tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:18 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-203b3783-3604-4274-b96a-f1784f0bdcaf tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:18 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-203b3783-3604-4274-b96a-f1784f0bdcaf tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] HTTP exception thrown: Instance 86893da2-3681-4a37-a6fc-1f56a2682070 could not be found. Apr 13 19:38:18 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-203b3783-3604-4274-b96a-f1784f0bdcaf tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Request method failure captured: Apr 13 19:38:18 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070 HTTP/1.1 Apr 13 19:38:18 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:38:18 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:38:18 user devstack@n-api.service[61588]: Connection: close Apr 13 19:38:18 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:38:18 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:38:18 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:38:18 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:38:18 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFdvUUNU3CyZfYq8lEiyknYArK8nkfrpiGCt9b8fTam0ipMnKPXUwxym-ZMuQE95pg5AM-XyAxuWw_Iwfsc0moQXJ1PD_km4KJ5j8ysffj-w-BZzcryYhn-EGsEISGrf0aVCPD-1rJmkvNHdmqgf35ImrndabMYEfBojUzhyScvCiUw Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Project-Id: ba0e42217cc44413951d6d5a87dbb886 Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Project-Name: tempest-TestMinimumBasicScenario-8202894 Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba0e42217cc44413951d6d5a87dbb886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ba0e42217cc44413951d6d5a87dbb886"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ba0e42217cc44413951d6d5a87dbb886"}]}] Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Tenant: tempest-TestMinimumBasicScenario-8202894 Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Tenant-Id: ba0e42217cc44413951d6d5a87dbb886 Apr 13 19:38:18 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TestMinimumBasicScenario-8202894 Apr 13 19:38:18 user devstack@n-api.service[61588]: X-User: tempest-TestMinimumBasicScenario-8202894-project-member Apr 13 19:38:18 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:38:18 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:38:18 user devstack@n-api.service[61588]: X-User-Id: 9b9ed2da2b4949269c2df77766a1835f Apr 13 19:38:18 user devstack@n-api.service[61588]: X-User-Name: tempest-TestMinimumBasicScenario-8202894-project-member Apr 13 19:38:18 user devstack@n-api.service[61588]: method: > Apr 13 19:38:18 user devstack@n-api.service[61588]: exception: Instance 86893da2-3681-4a37-a6fc-1f56a2682070 could not be found. Apr 13 19:38:18 user devstack@n-api.service[61588]: action_args: {'id': '86893da2-3681-4a37-a6fc-1f56a2682070'} Apr 13 19:38:18 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86893da2-3681-4a37-a6fc-1f56a2682070 could not be found. Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86893da2-3681-4a37-a6fc-1f56a2682070 could not be found. Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86893da2-3681-4a37-a6fc-1f56a2682070 could not be found. Apr 13 19:38:18 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:38:18 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-203b3783-3604-4274-b96a-f1784f0bdcaf tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Returning 404 to user: Instance 86893da2-3681-4a37-a6fc-1f56a2682070 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:38:18 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-203b3783-3604-4274-b96a-f1784f0bdcaf tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070" status: 404 len: 111 microversion: 2.1 time: 0.032599 Apr 13 19:38:18 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 375/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:38:18 2023] GET /compute/v2.1/servers/86893da2-3681-4a37-a6fc-1f56a2682070 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:38:18 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:38:18 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:38:18 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f9631a5a-8280-443d-baa3-29df3fc9e24f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Calling method '.version_select at 0x7efe33c22050>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:38:18 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f9631a5a-8280-443d-baa3-29df3fc9e24f tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-717246144" status: 202 len: 0 microversion: 2.1 time: 0.032257 Apr 13 19:38:18 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 376/1130] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 13 19:38:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-717246144 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:38:40 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:38:40 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=10 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:38:40 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:38:40 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:38:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:40 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:40 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:38:40 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" status: 204 len: 0 microversion: 2.87 time: 0.306402 Apr 13 19:38:40 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 380/1131] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:38:40 2023] DELETE /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-4962bf5e-8a34-49cb-a9eb-736508075ee2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-4962bf5e-8a34-49cb-a9eb-736508075ee2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4962bf5e-8a34-49cb-a9eb-736508075ee2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4962bf5e-8a34-49cb-a9eb-736508075ee2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4962bf5e-8a34-49cb-a9eb-736508075ee2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4962bf5e-8a34-49cb-a9eb-736508075ee2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4962bf5e-8a34-49cb-a9eb-736508075ee2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-4962bf5e-8a34-49cb-a9eb-736508075ee2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-4962bf5e-8a34-49cb-a9eb-736508075ee2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-4962bf5e-8a34-49cb-a9eb-736508075ee2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:38:40 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-4962bf5e-8a34-49cb-a9eb-736508075ee2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:38:40 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-4962bf5e-8a34-49cb-a9eb-736508075ee2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" status: 200 len: 1774 microversion: 2.87 time: 0.189875 Apr 13 19:38:40 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 376/1132] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:38:40 2023] GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => generated 1774 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:38:41 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:38:41 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-86b9b8d8-b0a1-4825-9e50-114565c4efe2 req-2f87c74a-0f8f-448b-9d77-2b7d459a1d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-unplugged", "status": "completed", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:38:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-86b9b8d8-b0a1-4825-9e50-114565c4efe2 req-2f87c74a-0f8f-448b-9d77-2b7d459a1d46 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-86b9b8d8-b0a1-4825-9e50-114565c4efe2 req-2f87c74a-0f8f-448b-9d77-2b7d459a1d46 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:41 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-86b9b8d8-b0a1-4825-9e50-114565c4efe2 req-2f87c74a-0f8f-448b-9d77-2b7d459a1d46 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-86b9b8d8-b0a1-4825-9e50-114565c4efe2 req-2f87c74a-0f8f-448b-9d77-2b7d459a1d46 service nova] Creating event network-vif-unplugged:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:38:41 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-86b9b8d8-b0a1-4825-9e50-114565c4efe2 req-2f87c74a-0f8f-448b-9d77-2b7d459a1d46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101197 Apr 13 19:38:41 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 377/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:38:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:38:42 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-246372ac-b46a-4a52-84d8-b92d090285df req-d7d8ed1e-46c3-471b-acd0-5aa05ef22adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-deleted", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:38:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-246372ac-b46a-4a52-84d8-b92d090285df req-d7d8ed1e-46c3-471b-acd0-5aa05ef22adc service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-246372ac-b46a-4a52-84d8-b92d090285df req-d7d8ed1e-46c3-471b-acd0-5aa05ef22adc service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:42 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-246372ac-b46a-4a52-84d8-b92d090285df req-d7d8ed1e-46c3-471b-acd0-5aa05ef22adc service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-246372ac-b46a-4a52-84d8-b92d090285df req-d7d8ed1e-46c3-471b-acd0-5aa05ef22adc service nova] Creating event network-vif-deleted:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:38:42 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-246372ac-b46a-4a52-84d8-b92d090285df req-d7d8ed1e-46c3-471b-acd0-5aa05ef22adc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032105 Apr 13 19:38:42 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 381/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:38:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:38:43 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-353d202a-5b9f-4e08-8e07-89032ad93c4a req-ebe64378-238c-4717-81c5-34bead96624e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76", "name": "network-vif-plugged", "status": "completed", "tag": "7d634c23-9eff-4a07-8036-b5ddc748828e"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:38:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-353d202a-5b9f-4e08-8e07-89032ad93c4a req-ebe64378-238c-4717-81c5-34bead96624e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-353d202a-5b9f-4e08-8e07-89032ad93c4a req-ebe64378-238c-4717-81c5-34bead96624e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:43 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-353d202a-5b9f-4e08-8e07-89032ad93c4a req-ebe64378-238c-4717-81c5-34bead96624e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-353d202a-5b9f-4e08-8e07-89032ad93c4a req-ebe64378-238c-4717-81c5-34bead96624e service nova] Creating event network-vif-plugged:7d634c23-9eff-4a07-8036-b5ddc748828e for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 on user Apr 13 19:38:43 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-353d202a-5b9f-4e08-8e07-89032ad93c4a req-ebe64378-238c-4717-81c5-34bead96624e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041207 Apr 13 19:38:43 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 377/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:38:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:38:50 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9727d143-2e82-4aaf-9480-d1309c423971 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:38:50 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-9727d143-2e82-4aaf-9480-d1309c423971 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:38:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9727d143-2e82-4aaf-9480-d1309c423971 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9727d143-2e82-4aaf-9480-d1309c423971 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9727d143-2e82-4aaf-9480-d1309c423971 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9727d143-2e82-4aaf-9480-d1309c423971 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9727d143-2e82-4aaf-9480-d1309c423971 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:50 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-9727d143-2e82-4aaf-9480-d1309c423971 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:50 user devstack@n-api.service[61589]: INFO nova.api.openstack.wsgi [None req-9727d143-2e82-4aaf-9480-d1309c423971 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c could not be found. Apr 13 19:38:50 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9727d143-2e82-4aaf-9480-d1309c423971 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:38:50 user devstack@n-api.service[61589]: request: GET /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c HTTP/1.1 Apr 13 19:38:50 user devstack@n-api.service[61589]: Accept: application/json Apr 13 19:38:50 user devstack@n-api.service[61589]: Accept-Encoding: identity Apr 13 19:38:50 user devstack@n-api.service[61589]: Connection: close Apr 13 19:38:50 user devstack@n-api.service[61589]: Content-Length: 0 Apr 13 19:38:50 user devstack@n-api.service[61589]: Content-Type: application/json Apr 13 19:38:50 user devstack@n-api.service[61589]: Host: 10.0.0.210 Apr 13 19:38:50 user devstack@n-api.service[61589]: Openstack-System-Scope: None Apr 13 19:38:50 user devstack@n-api.service[61589]: User-Agent: python-urllib3/1.26.15 Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Domain-Id: None Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Domain-Name: None Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Identity-Status: Confirmed Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Is-Admin-Project: True Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Project-Domain-Id: default Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Project-Domain-Name: Default Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Role: member,reader Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Roles: member,reader Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:38:50 user devstack@n-api.service[61589]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:38:50 user devstack@n-api.service[61589]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:38:50 user devstack@n-api.service[61589]: X-User-Domain-Id: default Apr 13 19:38:50 user devstack@n-api.service[61589]: X-User-Domain-Name: Default Apr 13 19:38:50 user devstack@n-api.service[61589]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:38:50 user devstack@n-api.service[61589]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:38:50 user devstack@n-api.service[61589]: method: > Apr 13 19:38:50 user devstack@n-api.service[61589]: exception: Instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c could not be found. Apr 13 19:38:50 user devstack@n-api.service[61589]: action_args: {'id': 'f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c'} Apr 13 19:38:50 user devstack@n-api.service[61589]: {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c could not be found. Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c could not be found. Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c could not be found. Apr 13 19:38:50 user devstack@n-api.service[61589]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-9727d143-2e82-4aaf-9480-d1309c423971 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c could not be found. {{(pid=61589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:38:50 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-9727d143-2e82-4aaf-9480-d1309c423971 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" status: 404 len: 111 microversion: 2.1 time: 0.028282 Apr 13 19:38:50 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 378/1136] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:38:50 2023] GET /compute/v2.1/servers/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:38:50 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-5a992d02-1d2c-43fb-9a77-aa8b0a9f58fd tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:38:50 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-5a992d02-1d2c-43fb-9a77-aa8b0a9f58fd tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:38:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5a992d02-1d2c-43fb-9a77-aa8b0a9f58fd tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5a992d02-1d2c-43fb-9a77-aa8b0a9f58fd tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5a992d02-1d2c-43fb-9a77-aa8b0a9f58fd tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5a992d02-1d2c-43fb-9a77-aa8b0a9f58fd tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5a992d02-1d2c-43fb-9a77-aa8b0a9f58fd tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:50 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-5a992d02-1d2c-43fb-9a77-aa8b0a9f58fd tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:50 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-5a992d02-1d2c-43fb-9a77-aa8b0a9f58fd tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:38:50 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-5a992d02-1d2c-43fb-9a77-aa8b0a9f58fd tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:38:50 user devstack@n-api.service[61587]: request: DELETE /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800 HTTP/1.1 Apr 13 19:38:50 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:38:50 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:38:50 user devstack@n-api.service[61587]: Connection: close Apr 13 19:38:50 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:38:50 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:38:50 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:38:50 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:38:50 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:38:50 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:38:50 user devstack@n-api.service[61587]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:38:50 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:38:50 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:38:50 user devstack@n-api.service[61587]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:38:50 user devstack@n-api.service[61587]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:38:50 user devstack@n-api.service[61587]: method: > Apr 13 19:38:50 user devstack@n-api.service[61587]: exception: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:38:50 user devstack@n-api.service[61587]: action_args: {'id': 'bbd7e115-1fc0-4c57-8ed8-eee343b69800'} Apr 13 19:38:50 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:38:50 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-5a992d02-1d2c-43fb-9a77-aa8b0a9f58fd tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:38:50 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-5a992d02-1d2c-43fb-9a77-aa8b0a9f58fd tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800" status: 404 len: 111 microversion: 2.1 time: 0.028538 Apr 13 19:38:50 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 382/1137] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:38:50 2023] DELETE /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:38:50 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c811935b-5e9e-46bd-aa61-c907ffdf6a9b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:38:50 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-c811935b-5e9e-46bd-aa61-c907ffdf6a9b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:38:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c811935b-5e9e-46bd-aa61-c907ffdf6a9b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c811935b-5e9e-46bd-aa61-c907ffdf6a9b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c811935b-5e9e-46bd-aa61-c907ffdf6a9b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c811935b-5e9e-46bd-aa61-c907ffdf6a9b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:38:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c811935b-5e9e-46bd-aa61-c907ffdf6a9b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:38:50 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c811935b-5e9e-46bd-aa61-c907ffdf6a9b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:38:50 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-c811935b-5e9e-46bd-aa61-c907ffdf6a9b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HTTP exception thrown: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:38:50 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c811935b-5e9e-46bd-aa61-c907ffdf6a9b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Request method failure captured: Apr 13 19:38:50 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800 HTTP/1.1 Apr 13 19:38:50 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:38:50 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:38:50 user devstack@n-api.service[61588]: Connection: close Apr 13 19:38:50 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:38:50 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:38:50 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:38:50 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:38:50 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFZN6cyB8WdF24OTJ3PwgtbfIiCAbkXckqaRjME4LDQyQ0kda1kOQZMxk5lnIIviwUVi0e2bWiLLM4TQF3kQtwGETS1O_XAh9A8c4t5KuryJbnaoovnBfLKDnqCT-8NH4jTPbbe2pq5_6VzS1LMlpC3h0gxvAQqAhLsKx4YDXMUU6p8 Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Project-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Project-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a5231d999e51417ebe91927707bfd2bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a5231d999e51417ebe91927707bfd2bd"}]}] Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Tenant: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Tenant-Id: a5231d999e51417ebe91927707bfd2bd Apr 13 19:38:50 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1717000141 Apr 13 19:38:50 user devstack@n-api.service[61588]: X-User: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:38:50 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:38:50 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:38:50 user devstack@n-api.service[61588]: X-User-Id: 526d9c809b81418d89da662f973a1bdc Apr 13 19:38:50 user devstack@n-api.service[61588]: X-User-Name: tempest-TestVolumeBootPattern-1717000141-project-member Apr 13 19:38:50 user devstack@n-api.service[61588]: method: > Apr 13 19:38:50 user devstack@n-api.service[61588]: exception: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:38:50 user devstack@n-api.service[61588]: action_args: {'id': 'bbd7e115-1fc0-4c57-8ed8-eee343b69800'} Apr 13 19:38:50 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. Apr 13 19:38:50 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:38:50 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c811935b-5e9e-46bd-aa61-c907ffdf6a9b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Returning 404 to user: Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:38:50 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-c811935b-5e9e-46bd-aa61-c907ffdf6a9b tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800" status: 404 len: 111 microversion: 2.1 time: 0.028229 Apr 13 19:38:50 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 378/1138] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:38:50 2023] GET /compute/v2.1/servers/bbd7e115-1fc0-4c57-8ed8-eee343b69800 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 19:38:53 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f751ce75-4dc1-4d6c-8fb2-8e39e16052cf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Calling method '.version_select at 0x7efe33d5f760>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:38:53 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f751ce75-4dc1-4d6c-8fb2-8e39e16052cf tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1410205426" status: 202 len: 0 microversion: 2.1 time: 0.021457 Apr 13 19:38:53 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 379/1139] 10.0.0.210 () {62 vars in 1340 bytes} [Thu Apr 13 19:38:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1410205426 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-153d4962-ec7a-4e3a-83ee-224b648e3bc1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-153d4962-ec7a-4e3a-83ee-224b648e3bc1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-153d4962-ec7a-4e3a-83ee-224b648e3bc1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-153d4962-ec7a-4e3a-83ee-224b648e3bc1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-153d4962-ec7a-4e3a-83ee-224b648e3bc1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-153d4962-ec7a-4e3a-83ee-224b648e3bc1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-153d4962-ec7a-4e3a-83ee-224b648e3bc1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-153d4962-ec7a-4e3a-83ee-224b648e3bc1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:39:31 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-153d4962-ec7a-4e3a-83ee-224b648e3bc1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] HTTP exception thrown: Instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 could not be found. Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-153d4962-ec7a-4e3a-83ee-224b648e3bc1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Request method failure captured: Apr 13 19:39:31 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 HTTP/1.1 Apr 13 19:39:31 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:39:31 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:39:31 user devstack@n-api.service[61587]: Connection: close Apr 13 19:39:31 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:39:31 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:39:31 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:39:31 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:39:31 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFZBeGiwrmCeO5_hmtsBLxCyU07HIR0h7dMim0GbNpOEf-0bt7Sws_Od8J5wG9H4duiPwyMFlgmMIRh5pPJHPw8JrNW_FQGK1j_suFMSG_LdR25Sw8MCOBi5Hpuh7jnq6Pd_Iy76Td5ZNNOyjtd1B7B-tMsiTySqY7ECGKZnH291N44 Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Project-Id: c00a7fcd6d3040e8b2db0448eeda93ad Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1051313256 Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c00a7fcd6d3040e8b2db0448eeda93ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c00a7fcd6d3040e8b2db0448eeda93ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c00a7fcd6d3040e8b2db0448eeda93ad"}]}] Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1051313256 Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Tenant-Id: c00a7fcd6d3040e8b2db0448eeda93ad Apr 13 19:39:31 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1051313256 Apr 13 19:39:31 user devstack@n-api.service[61587]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member Apr 13 19:39:31 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:39:31 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:39:31 user devstack@n-api.service[61587]: X-User-Id: dd604fa4d17b42b1abea8c2f2405b58d Apr 13 19:39:31 user devstack@n-api.service[61587]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member Apr 13 19:39:31 user devstack@n-api.service[61587]: method: > Apr 13 19:39:31 user devstack@n-api.service[61587]: exception: Instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 could not be found. Apr 13 19:39:31 user devstack@n-api.service[61587]: action_args: {'id': 'f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76'} Apr 13 19:39:31 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 could not be found. Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 could not be found. Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 could not be found. Apr 13 19:39:31 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-153d4962-ec7a-4e3a-83ee-224b648e3bc1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Returning 404 to user: Instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:39:31 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-153d4962-ec7a-4e3a-83ee-224b648e3bc1 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" status: 404 len: 111 microversion: 2.87 time: 0.037138 Apr 13 19:39:31 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 383/1140] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:39:31 2023] GET /compute/v2.1/servers/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:39:31 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:39:31 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:39:31 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=8 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:39:31 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=10 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:39:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:39:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:39:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:39:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:39:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:39:31 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:39:31 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Going to try to terminate instance {{(pid=61588) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:39:31 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" status: 204 len: 0 microversion: 2.87 time: 0.317997 Apr 13 19:39:31 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 379/1141] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:39:31 2023] DELETE /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 13 19:39:31 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:39:31 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:39:31 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-8d5db4d0-99ba-4122-9684-7ad60ca16cee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:39:31 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-8d5db4d0-99ba-4122-9684-7ad60ca16cee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:39:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8d5db4d0-99ba-4122-9684-7ad60ca16cee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:39:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8d5db4d0-99ba-4122-9684-7ad60ca16cee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:39:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8d5db4d0-99ba-4122-9684-7ad60ca16cee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:39:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8d5db4d0-99ba-4122-9684-7ad60ca16cee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:39:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8d5db4d0-99ba-4122-9684-7ad60ca16cee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:39:31 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-8d5db4d0-99ba-4122-9684-7ad60ca16cee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-d4d931bc-fa9b-4e2b-ac0f-e94ab74a3832 req-dad1c536-c954-4a97-a828-cf1b98b8868b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6", "name": "network-vif-unplugged", "status": "completed", "tag": "89ac5520-b022-42dd-a10d-6621de9ecd5f"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d4d931bc-fa9b-4e2b-ac0f-e94ab74a3832 req-dad1c536-c954-4a97-a828-cf1b98b8868b service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d4d931bc-fa9b-4e2b-ac0f-e94ab74a3832 req-dad1c536-c954-4a97-a828-cf1b98b8868b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:39:31 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-d4d931bc-fa9b-4e2b-ac0f-e94ab74a3832 req-dad1c536-c954-4a97-a828-cf1b98b8868b service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:39:31 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-d4d931bc-fa9b-4e2b-ac0f-e94ab74a3832 req-dad1c536-c954-4a97-a828-cf1b98b8868b service nova] Creating event network-vif-unplugged:89ac5520-b022-42dd-a10d-6621de9ecd5f for instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 on user Apr 13 19:39:31 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-d4d931bc-fa9b-4e2b-ac0f-e94ab74a3832 req-dad1c536-c954-4a97-a828-cf1b98b8868b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054550 Apr 13 19:39:31 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 384/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:39:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:39:32 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-8d5db4d0-99ba-4122-9684-7ad60ca16cee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:39:32 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-8d5db4d0-99ba-4122-9684-7ad60ca16cee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:39:32 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-8d5db4d0-99ba-4122-9684-7ad60ca16cee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:39:32 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-8d5db4d0-99ba-4122-9684-7ad60ca16cee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" status: 200 len: 1696 microversion: 2.87 time: 0.677820 Apr 13 19:39:32 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 380/1143] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:39:31 2023] GET /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 => generated 1696 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:39:34 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6", "name": "network-vif-plugged", "status": "completed", "tag": "89ac5520-b022-42dd-a10d-6621de9ecd5f"}, {"server_uuid": "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6", "name": "network-vif-deleted", "tag": "89ac5520-b022-42dd-a10d-6621de9ecd5f"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:39:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:39:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:39:34 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:39:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] Creating event network-vif-plugged:89ac5520-b022-42dd-a10d-6621de9ecd5f for instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 on user Apr 13 19:39:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] Creating event network-vif-deleted:89ac5520-b022-42dd-a10d-6621de9ecd5f for instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 on user Apr 13 19:39:34 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049127 Apr 13 19:39:34 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 380/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:39:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [29d83c95-db65-4eb1-9264-72893997627a] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-afee6042-4478-408d-90d0-8b5eedefd4f3 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-afee6042-4478-408d-90d0-8b5eedefd4f3 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-afee6042-4478-408d-90d0-8b5eedefd4f3 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-afee6042-4478-408d-90d0-8b5eedefd4f3 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-afee6042-4478-408d-90d0-8b5eedefd4f3 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-afee6042-4478-408d-90d0-8b5eedefd4f3 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-afee6042-4478-408d-90d0-8b5eedefd4f3 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-afee6042-4478-408d-90d0-8b5eedefd4f3 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:40:22 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-afee6042-4478-408d-90d0-8b5eedefd4f3 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] HTTP exception thrown: Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 could not be found. Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-afee6042-4478-408d-90d0-8b5eedefd4f3 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Request method failure captured: Apr 13 19:40:22 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 HTTP/1.1 Apr 13 19:40:22 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:40:22 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:40:22 user devstack@n-api.service[61587]: Connection: close Apr 13 19:40:22 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:40:22 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:40:22 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:40:22 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:40:22 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFZBeGiwrmCeO5_hmtsBLxCyU07HIR0h7dMim0GbNpOEf-0bt7Sws_Od8J5wG9H4duiPwyMFlgmMIRh5pPJHPw8JrNW_FQGK1j_suFMSG_LdR25Sw8MCOBi5Hpuh7jnq6Pd_Iy76Td5ZNNOyjtd1B7B-tMsiTySqY7ECGKZnH291N44 Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Project-Id: c00a7fcd6d3040e8b2db0448eeda93ad Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1051313256 Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c00a7fcd6d3040e8b2db0448eeda93ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c00a7fcd6d3040e8b2db0448eeda93ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c00a7fcd6d3040e8b2db0448eeda93ad"}]}] Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1051313256 Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Tenant-Id: c00a7fcd6d3040e8b2db0448eeda93ad Apr 13 19:40:22 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1051313256 Apr 13 19:40:22 user devstack@n-api.service[61587]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member Apr 13 19:40:22 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:40:22 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:40:22 user devstack@n-api.service[61587]: X-User-Id: dd604fa4d17b42b1abea8c2f2405b58d Apr 13 19:40:22 user devstack@n-api.service[61587]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member Apr 13 19:40:22 user devstack@n-api.service[61587]: method: > Apr 13 19:40:22 user devstack@n-api.service[61587]: exception: Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 could not be found. Apr 13 19:40:22 user devstack@n-api.service[61587]: action_args: {'id': 'fd2fe4b2-e5ae-487f-bda2-6b3102204ad6'} Apr 13 19:40:22 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 could not be found. Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 could not be found. Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 could not be found. Apr 13 19:40:22 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-afee6042-4478-408d-90d0-8b5eedefd4f3 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Returning 404 to user: Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:40:22 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-afee6042-4478-408d-90d0-8b5eedefd4f3 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" status: 404 len: 111 microversion: 2.87 time: 0.036246 Apr 13 19:40:22 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 385/1145] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:40:22 2023] GET /compute/v2.1/servers/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:40:22 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:40:22 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:40:22 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:40:22 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=4 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:40:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:40:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:40:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:40:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:40:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:40:22 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:40:22 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Going to try to terminate instance {{(pid=61589) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:40:22 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a" status: 204 len: 0 microversion: 2.87 time: 0.120800 Apr 13 19:40:22 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 381/1146] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:40:22 2023] DELETE /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-c93bb344-77ff-4553-91ac-beb9a351890c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-c93bb344-77ff-4553-91ac-beb9a351890c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c93bb344-77ff-4553-91ac-beb9a351890c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c93bb344-77ff-4553-91ac-beb9a351890c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c93bb344-77ff-4553-91ac-beb9a351890c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c93bb344-77ff-4553-91ac-beb9a351890c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c93bb344-77ff-4553-91ac-beb9a351890c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-c93bb344-77ff-4553-91ac-beb9a351890c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-c93bb344-77ff-4553-91ac-beb9a351890c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-c93bb344-77ff-4553-91ac-beb9a351890c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:40:22 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-c93bb344-77ff-4553-91ac-beb9a351890c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:40:22 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-c93bb344-77ff-4553-91ac-beb9a351890c tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a" status: 200 len: 1774 microversion: 2.87 time: 0.264163 Apr 13 19:40:22 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 381/1147] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:40:22 2023] GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a => generated 1774 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-acce0339-751b-454b-9230-14b4c1ae82b6 req-b39f1f56-3181-449c-9ee7-02b2f298eff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-unplugged", "status": "completed", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-acce0339-751b-454b-9230-14b4c1ae82b6 req-b39f1f56-3181-449c-9ee7-02b2f298eff8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-acce0339-751b-454b-9230-14b4c1ae82b6 req-b39f1f56-3181-449c-9ee7-02b2f298eff8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:40:22 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-acce0339-751b-454b-9230-14b4c1ae82b6 req-b39f1f56-3181-449c-9ee7-02b2f298eff8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:40:22 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-acce0339-751b-454b-9230-14b4c1ae82b6 req-b39f1f56-3181-449c-9ee7-02b2f298eff8 service nova] Creating event network-vif-unplugged:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:40:22 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-acce0339-751b-454b-9230-14b4c1ae82b6 req-b39f1f56-3181-449c-9ee7-02b2f298eff8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028067 Apr 13 19:40:22 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 386/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:40:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:40:24 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-1d653527-9af8-4f10-88b4-db392b6560ba req-dbd48dea-8aa1-424c-9cb9-888c4717d6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-deleted", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:40:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1d653527-9af8-4f10-88b4-db392b6560ba req-dbd48dea-8aa1-424c-9cb9-888c4717d6f7 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:40:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1d653527-9af8-4f10-88b4-db392b6560ba req-dbd48dea-8aa1-424c-9cb9-888c4717d6f7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:40:24 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-1d653527-9af8-4f10-88b4-db392b6560ba req-dbd48dea-8aa1-424c-9cb9-888c4717d6f7 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:40:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-1d653527-9af8-4f10-88b4-db392b6560ba req-dbd48dea-8aa1-424c-9cb9-888c4717d6f7 service nova] Creating event network-vif-deleted:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:40:24 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-1d653527-9af8-4f10-88b4-db392b6560ba req-dbd48dea-8aa1-424c-9cb9-888c4717d6f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093590 Apr 13 19:40:24 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 382/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:40:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:40:24 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-299f7536-54d0-4fa4-b638-d97892f50763 req-91539a9d-6acc-450a-85b1-5d5766dfd9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871a0-3a4e-4014-b07f-3e8c49eeda5a", "name": "network-vif-plugged", "status": "completed", "tag": "405a3575-62ce-4c5c-8090-40f2fabf7d61"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:40:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-299f7536-54d0-4fa4-b638-d97892f50763 req-91539a9d-6acc-450a-85b1-5d5766dfd9d8 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:40:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-299f7536-54d0-4fa4-b638-d97892f50763 req-91539a9d-6acc-450a-85b1-5d5766dfd9d8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:40:24 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-299f7536-54d0-4fa4-b638-d97892f50763 req-91539a9d-6acc-450a-85b1-5d5766dfd9d8 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:40:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-299f7536-54d0-4fa4-b638-d97892f50763 req-91539a9d-6acc-450a-85b1-5d5766dfd9d8 service nova] Creating event network-vif-plugged:405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a on user Apr 13 19:40:24 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-299f7536-54d0-4fa4-b638-d97892f50763 req-91539a9d-6acc-450a-85b1-5d5766dfd9d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030788 Apr 13 19:40:24 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 382/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:40:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:41:12 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:41:12 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:41:12 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0c06b7c9-9d2f-4433-b833-a68e8810e453 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:41:12 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-0c06b7c9-9d2f-4433-b833-a68e8810e453 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:41:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0c06b7c9-9d2f-4433-b833-a68e8810e453 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:41:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0c06b7c9-9d2f-4433-b833-a68e8810e453 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:41:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0c06b7c9-9d2f-4433-b833-a68e8810e453 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:41:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0c06b7c9-9d2f-4433-b833-a68e8810e453 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:41:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0c06b7c9-9d2f-4433-b833-a68e8810e453 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:41:12 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-0c06b7c9-9d2f-4433-b833-a68e8810e453 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:41:12 user devstack@n-api.service[61587]: INFO oslo.messaging._drivers.impl_rabbit [-] [29d83c95-db65-4eb1-9264-72893997627a] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 51028. Apr 13 19:41:12 user devstack@n-api.service[61587]: INFO nova.api.openstack.wsgi [None req-0c06b7c9-9d2f-4433-b833-a68e8810e453 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] HTTP exception thrown: Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a could not be found. Apr 13 19:41:12 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0c06b7c9-9d2f-4433-b833-a68e8810e453 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Request method failure captured: Apr 13 19:41:12 user devstack@n-api.service[61587]: request: GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a HTTP/1.1 Apr 13 19:41:12 user devstack@n-api.service[61587]: Accept: application/json Apr 13 19:41:12 user devstack@n-api.service[61587]: Accept-Encoding: identity Apr 13 19:41:12 user devstack@n-api.service[61587]: Connection: close Apr 13 19:41:12 user devstack@n-api.service[61587]: Content-Length: 0 Apr 13 19:41:12 user devstack@n-api.service[61587]: Content-Type: application/json Apr 13 19:41:12 user devstack@n-api.service[61587]: Host: 10.0.0.210 Apr 13 19:41:12 user devstack@n-api.service[61587]: Openstack-System-Scope: None Apr 13 19:41:12 user devstack@n-api.service[61587]: User-Agent: python-urllib3/1.26.15 Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Auth-Token: gAAAAABkOFZBeGiwrmCeO5_hmtsBLxCyU07HIR0h7dMim0GbNpOEf-0bt7Sws_Od8J5wG9H4duiPwyMFlgmMIRh5pPJHPw8JrNW_FQGK1j_suFMSG_LdR25Sw8MCOBi5Hpuh7jnq6Pd_Iy76Td5ZNNOyjtd1B7B-tMsiTySqY7ECGKZnH291N44 Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Domain-Id: None Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Domain-Name: None Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Identity-Status: Confirmed Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Is-Admin-Project: True Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Project-Domain-Id: default Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Project-Domain-Name: Default Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Project-Id: c00a7fcd6d3040e8b2db0448eeda93ad Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1051313256 Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Role: member,reader Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Roles: member,reader Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c00a7fcd6d3040e8b2db0448eeda93ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c00a7fcd6d3040e8b2db0448eeda93ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c00a7fcd6d3040e8b2db0448eeda93ad"}]}] Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1051313256 Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Tenant-Id: c00a7fcd6d3040e8b2db0448eeda93ad Apr 13 19:41:12 user devstack@n-api.service[61587]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1051313256 Apr 13 19:41:12 user devstack@n-api.service[61587]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member Apr 13 19:41:12 user devstack@n-api.service[61587]: X-User-Domain-Id: default Apr 13 19:41:12 user devstack@n-api.service[61587]: X-User-Domain-Name: Default Apr 13 19:41:12 user devstack@n-api.service[61587]: X-User-Id: dd604fa4d17b42b1abea8c2f2405b58d Apr 13 19:41:12 user devstack@n-api.service[61587]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member Apr 13 19:41:12 user devstack@n-api.service[61587]: method: > Apr 13 19:41:12 user devstack@n-api.service[61587]: exception: Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a could not be found. Apr 13 19:41:12 user devstack@n-api.service[61587]: action_args: {'id': '991871a0-3a4e-4014-b07f-3e8c49eeda5a'} Apr 13 19:41:12 user devstack@n-api.service[61587]: {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a could not be found. Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a could not be found. Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a could not be found. Apr 13 19:41:12 user devstack@n-api.service[61587]: ERROR nova.api.openstack.wsgi Apr 13 19:41:12 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-0c06b7c9-9d2f-4433-b833-a68e8810e453 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Returning 404 to user: Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a could not be found. {{(pid=61587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:41:12 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-0c06b7c9-9d2f-4433-b833-a68e8810e453 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a" status: 404 len: 111 microversion: 2.87 time: 0.046213 Apr 13 19:41:12 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 387/1151] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:41:12 2023] GET /compute/v2.1/servers/991871a0-3a4e-4014-b07f-3e8c49eeda5a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:41:13 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:41:13 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:41:13 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:41:13 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:41:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:41:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:41:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:41:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:41:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:41:13 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:41:13 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Going to try to terminate instance {{(pid=61589) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:41:13 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" status: 204 len: 0 microversion: 2.87 time: 0.118850 Apr 13 19:41:13 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 383/1152] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 19:41:13 2023] DELETE /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=8 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:41:13 user devstack@n-api.service[61588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 19:41:13 user devstack@n-api.service[61588]: Thu Apr 13 19:41:13 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 (ip 10.0.0.210) !!! Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-9e443f87-a4a7-4f54-9f72-d2bf3e56aac2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-9e443f87-a4a7-4f54-9f72-d2bf3e56aac2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9e443f87-a4a7-4f54-9f72-d2bf3e56aac2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9e443f87-a4a7-4f54-9f72-d2bf3e56aac2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9e443f87-a4a7-4f54-9f72-d2bf3e56aac2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9e443f87-a4a7-4f54-9f72-d2bf3e56aac2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9e443f87-a4a7-4f54-9f72-d2bf3e56aac2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-9e443f87-a4a7-4f54-9f72-d2bf3e56aac2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-9e443f87-a4a7-4f54-9f72-d2bf3e56aac2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-9e443f87-a4a7-4f54-9f72-d2bf3e56aac2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:41:13 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-9e443f87-a4a7-4f54-9f72-d2bf3e56aac2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:41:13 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-9e443f87-a4a7-4f54-9f72-d2bf3e56aac2 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" status: 200 len: 1696 microversion: 2.87 time: 0.207575 Apr 13 19:41:13 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 383/1153] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:41:13 2023] GET /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 19:41:13 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-745ca4c4-49a1-43ac-aaa0-21497c03eb2d req-28e891e8-0bc4-42d8-baa0-5e7696fdf812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96", "name": "network-vif-unplugged", "status": "completed", "tag": "5bd81344-f669-49c6-897f-97510d86e77b"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:41:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-745ca4c4-49a1-43ac-aaa0-21497c03eb2d req-28e891e8-0bc4-42d8-baa0-5e7696fdf812 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:41:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-745ca4c4-49a1-43ac-aaa0-21497c03eb2d req-28e891e8-0bc4-42d8-baa0-5e7696fdf812 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:41:13 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-745ca4c4-49a1-43ac-aaa0-21497c03eb2d req-28e891e8-0bc4-42d8-baa0-5e7696fdf812 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:41:13 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-745ca4c4-49a1-43ac-aaa0-21497c03eb2d req-28e891e8-0bc4-42d8-baa0-5e7696fdf812 service nova] Creating event network-vif-unplugged:5bd81344-f669-49c6-897f-97510d86e77b for instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 on user Apr 13 19:41:13 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-745ca4c4-49a1-43ac-aaa0-21497c03eb2d req-28e891e8-0bc4-42d8-baa0-5e7696fdf812 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031942 Apr 13 19:41:13 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 388/1154] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:41:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:41:15 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96", "name": "network-vif-plugged", "status": "completed", "tag": "5bd81344-f669-49c6-897f-97510d86e77b"}, {"server_uuid": "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96", "name": "network-vif-deleted", "tag": "5bd81344-f669-49c6-897f-97510d86e77b"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:41:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:41:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:41:15 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:41:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] Creating event network-vif-plugged:5bd81344-f669-49c6-897f-97510d86e77b for instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 on user Apr 13 19:41:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] Creating event network-vif-deleted:5bd81344-f669-49c6-897f-97510d86e77b for instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 on user Apr 13 19:41:15 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029095 Apr 13 19:41:15 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 384/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:41:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:42:03 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0fecfe0c-6c67-4fcf-8cda-3ae60300cdee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:42:03 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-0fecfe0c-6c67-4fcf-8cda-3ae60300cdee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:42:03 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:42:03 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=4 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:42:03 user devstack@n-api.service[61588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 19:42:03 user devstack@n-api.service[61588]: Thu Apr 13 19:42:03 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 (ip 10.0.0.210) !!! Apr 13 19:42:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0fecfe0c-6c67-4fcf-8cda-3ae60300cdee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:42:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0fecfe0c-6c67-4fcf-8cda-3ae60300cdee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:42:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0fecfe0c-6c67-4fcf-8cda-3ae60300cdee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:42:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0fecfe0c-6c67-4fcf-8cda-3ae60300cdee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:42:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0fecfe0c-6c67-4fcf-8cda-3ae60300cdee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:42:03 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-0fecfe0c-6c67-4fcf-8cda-3ae60300cdee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:42:03 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-0fecfe0c-6c67-4fcf-8cda-3ae60300cdee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] HTTP exception thrown: Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 could not be found. Apr 13 19:42:03 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0fecfe0c-6c67-4fcf-8cda-3ae60300cdee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Request method failure captured: Apr 13 19:42:03 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 HTTP/1.1 Apr 13 19:42:03 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:42:03 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:42:03 user devstack@n-api.service[61588]: Connection: close Apr 13 19:42:03 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:42:03 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:42:03 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:42:03 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:42:03 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFZBeGiwrmCeO5_hmtsBLxCyU07HIR0h7dMim0GbNpOEf-0bt7Sws_Od8J5wG9H4duiPwyMFlgmMIRh5pPJHPw8JrNW_FQGK1j_suFMSG_LdR25Sw8MCOBi5Hpuh7jnq6Pd_Iy76Td5ZNNOyjtd1B7B-tMsiTySqY7ECGKZnH291N44 Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Project-Id: c00a7fcd6d3040e8b2db0448eeda93ad Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1051313256 Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c00a7fcd6d3040e8b2db0448eeda93ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c00a7fcd6d3040e8b2db0448eeda93ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c00a7fcd6d3040e8b2db0448eeda93ad"}]}] Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1051313256 Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Tenant-Id: c00a7fcd6d3040e8b2db0448eeda93ad Apr 13 19:42:03 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1051313256 Apr 13 19:42:03 user devstack@n-api.service[61588]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member Apr 13 19:42:03 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:42:03 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:42:03 user devstack@n-api.service[61588]: X-User-Id: dd604fa4d17b42b1abea8c2f2405b58d Apr 13 19:42:03 user devstack@n-api.service[61588]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member Apr 13 19:42:03 user devstack@n-api.service[61588]: method: > Apr 13 19:42:03 user devstack@n-api.service[61588]: exception: Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 could not be found. Apr 13 19:42:03 user devstack@n-api.service[61588]: action_args: {'id': '2d0186ca-d0ab-46f3-b9b5-6461e8ceef96'} Apr 13 19:42:03 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 could not be found. Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 could not be found. Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 could not be found. Apr 13 19:42:03 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:42:03 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-0fecfe0c-6c67-4fcf-8cda-3ae60300cdee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Returning 404 to user: Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:42:03 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-0fecfe0c-6c67-4fcf-8cda-3ae60300cdee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" status: 404 len: 111 microversion: 2.87 time: 0.044291 Apr 13 19:42:03 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 384/1156] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 19:42:03 2023] GET /compute/v2.1/servers/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 19:42:55 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:42:55 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:42:55 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1326800621", "imageRef": "e5467a4f-b219-48a2-9412-0a7e7ac851c3", "flavorRef": "42"}} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG nova.network.neutron [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] validate_networks() for None {{(pid=61587) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Flavor limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Image limits 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Flavor pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Image pref 0:0:0 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Getting quotas for project ee076581e18f48349a20be41e4634b72. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG nova.quota [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Getting quotas for user 7cc805b367d6459f92d36f349737dc75 and project ee076581e18f48349a20be41e4634b72. Resources: {'cores', 'ram', 'instances'} {{(pid=61587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Going to run 1 instances... {{(pid=61587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 19:42:56 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e5467a4f-b219-48a2-9412-0a7e7ac851c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 19:42:56 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.652966 Apr 13 19:42:56 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 389/1157] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 19:42:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 19:42:56 user devstack@n-api.service[61589]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f8ce949-5498-43d4-8403-7eb7c16fade3] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 19:42:56 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:42:56 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:42:56 user devstack@n-api.service[61589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 19:42:56 user devstack@n-api.service[61589]: Thu Apr 13 19:42:56 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f (ip 10.0.0.210) !!! Apr 13 19:42:56 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-3d34bd34-29e9-4f2d-8d0f-f0062b906c6c tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:42:56 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-3d34bd34-29e9-4f2d-8d0f-f0062b906c6c tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:42:56 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-3d34bd34-29e9-4f2d-8d0f-f0062b906c6c tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc805b367d6459f92d36f349737dc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee076581e18f48349a20be41e4634b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:42:56 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-3d34bd34-29e9-4f2d-8d0f-f0062b906c6c tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f" status: 200 len: 1209 microversion: 2.1 time: 0.088974 Apr 13 19:42:56 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 385/1158] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:42:56 2023] GET /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:42:59 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d939b5e-fb83-47fd-93ff-b77618bd803f", "tag": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:42:59 user devstack@n-api.service[61588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d96600fe-3d50-4a3b-b2cc-05e6067cdb6e] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 19:42:59 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:42:59 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:42:59 user devstack@n-api.service[61588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 19:42:59 user devstack@n-api.service[61588]: Thu Apr 13 19:42:59 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 13 19:42:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:42:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:42:59 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:42:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] Creating event network-changed:2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 for instance 7d939b5e-fb83-47fd-93ff-b77618bd803f on user Apr 13 19:42:59 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041987 Apr 13 19:42:59 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 385/1159] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:42:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:43:01 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-45afbc74-4786-4d7b-82ff-b1e6272d798c req-75b07195-4835-4163-b10c-e4f01751e989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d939b5e-fb83-47fd-93ff-b77618bd803f", "name": "network-vif-plugged", "status": "completed", "tag": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:43:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-45afbc74-4786-4d7b-82ff-b1e6272d798c req-75b07195-4835-4163-b10c-e4f01751e989 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:43:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-45afbc74-4786-4d7b-82ff-b1e6272d798c req-75b07195-4835-4163-b10c-e4f01751e989 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:43:01 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-45afbc74-4786-4d7b-82ff-b1e6272d798c req-75b07195-4835-4163-b10c-e4f01751e989 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:43:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-45afbc74-4786-4d7b-82ff-b1e6272d798c req-75b07195-4835-4163-b10c-e4f01751e989 service nova] Creating event network-vif-plugged:2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 for instance 7d939b5e-fb83-47fd-93ff-b77618bd803f on user Apr 13 19:43:01 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-45afbc74-4786-4d7b-82ff-b1e6272d798c req-75b07195-4835-4163-b10c-e4f01751e989 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030926 Apr 13 19:43:01 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 390/1160] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:43:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:43:03 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-915b6316-e4a2-413f-927d-242aef15ed36 req-bacf5c6e-84f2-4d35-ac45-a21d4857e2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d939b5e-fb83-47fd-93ff-b77618bd803f", "name": "network-vif-plugged", "status": "completed", "tag": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:43:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-915b6316-e4a2-413f-927d-242aef15ed36 req-bacf5c6e-84f2-4d35-ac45-a21d4857e2c2 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:43:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-915b6316-e4a2-413f-927d-242aef15ed36 req-bacf5c6e-84f2-4d35-ac45-a21d4857e2c2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:43:03 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-915b6316-e4a2-413f-927d-242aef15ed36 req-bacf5c6e-84f2-4d35-ac45-a21d4857e2c2 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:43:03 user devstack@n-api.service[61589]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f8ce949-5498-43d4-8403-7eb7c16fade3] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 42512. Apr 13 19:43:03 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-915b6316-e4a2-413f-927d-242aef15ed36 req-bacf5c6e-84f2-4d35-ac45-a21d4857e2c2 service nova] Creating event network-vif-plugged:2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 for instance 7d939b5e-fb83-47fd-93ff-b77618bd803f on user Apr 13 19:43:03 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-915b6316-e4a2-413f-927d-242aef15ed36 req-bacf5c6e-84f2-4d35-ac45-a21d4857e2c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032922 Apr 13 19:43:03 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 386/1161] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:43:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:43:46 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:43:46 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:43:46 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-6b0b2fa0-4d87-455b-88f0-b2d552d07104 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:43:46 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-6b0b2fa0-4d87-455b-88f0-b2d552d07104 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:43:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6b0b2fa0-4d87-455b-88f0-b2d552d07104 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:43:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6b0b2fa0-4d87-455b-88f0-b2d552d07104 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:43:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6b0b2fa0-4d87-455b-88f0-b2d552d07104 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:43:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6b0b2fa0-4d87-455b-88f0-b2d552d07104 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:43:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6b0b2fa0-4d87-455b-88f0-b2d552d07104 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:43:46 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-6b0b2fa0-4d87-455b-88f0-b2d552d07104 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:43:46 user devstack@n-api.service[61588]: INFO oslo.messaging._drivers.impl_rabbit [-] [d96600fe-3d50-4a3b-b2cc-05e6067cdb6e] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 58538. Apr 13 19:43:46 user devstack@n-api.service[61588]: DEBUG nova.policy [None req-6b0b2fa0-4d87-455b-88f0-b2d552d07104 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc805b367d6459f92d36f349737dc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee076581e18f48349a20be41e4634b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61588) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:43:46 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-6b0b2fa0-4d87-455b-88f0-b2d552d07104 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f" status: 200 len: 1455 microversion: 2.1 time: 0.166251 Apr 13 19:43:46 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 386/1162] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:43:46 2023] GET /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f => generated 1455 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=2 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell0:SELECT=6 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:44:46 user devstack@n-api.service[61587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 19:44:46 user devstack@n-api.service[61587]: Thu Apr 13 19:44:46 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f (ip 10.0.0.210) !!! Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG dbcounter [-] [61587] Writing DB stats nova_cell1:SELECT=4 {{(pid=61587) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Calling method '>' {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Fetching instance by UUID {{(pid=61587) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:44:46 user devstack@n-api.service[61587]: DEBUG nova.compute.api [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Going to try to terminate instance {{(pid=61587) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 19:44:46 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f" status: 204 len: 0 microversion: 2.1 time: 0.130882 Apr 13 19:44:46 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 391/1163] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 19:44:46 2023] DELETE /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 19:44:46 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell0:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:44:46 user devstack@n-api.service[61589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 19:44:46 user devstack@n-api.service[61589]: Thu Apr 13 19:44:46 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f (ip 10.0.0.210) !!! Apr 13 19:44:46 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_api:SELECT=6 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:44:46 user devstack@n-api.service[61589]: DEBUG dbcounter [-] [61589] Writing DB stats nova_cell1:SELECT=2 {{(pid=61589) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:44:46 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [None req-f3a5f52b-5c94-48d4-8360-a3fa33a7a0b3 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Calling method '>' {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:44:46 user devstack@n-api.service[61589]: DEBUG nova.compute.api [None req-f3a5f52b-5c94-48d4-8360-a3fa33a7a0b3 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Fetching instance by UUID {{(pid=61589) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:44:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f3a5f52b-5c94-48d4-8360-a3fa33a7a0b3 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:44:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f3a5f52b-5c94-48d4-8360-a3fa33a7a0b3 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:44:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f3a5f52b-5c94-48d4-8360-a3fa33a7a0b3 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:44:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f3a5f52b-5c94-48d4-8360-a3fa33a7a0b3 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:44:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f3a5f52b-5c94-48d4-8360-a3fa33a7a0b3 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:44:46 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [None req-f3a5f52b-5c94-48d4-8360-a3fa33a7a0b3 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:44:47 user devstack@n-api.service[61589]: DEBUG nova.policy [None req-f3a5f52b-5c94-48d4-8360-a3fa33a7a0b3 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc805b367d6459f92d36f349737dc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee076581e18f48349a20be41e4634b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61589) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 19:44:47 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [None req-f3a5f52b-5c94-48d4-8360-a3fa33a7a0b3 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f" status: 200 len: 1461 microversion: 2.1 time: 0.300338 Apr 13 19:44:47 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 387/1164] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:44:46 2023] GET /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f => generated 1461 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 19:44:47 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:44:47 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=6 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:44:47 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [req-02191640-898b-490e-bbd0-bab72d047f03 req-3e32dfab-b12d-48c4-a4af-01298489b6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d939b5e-fb83-47fd-93ff-b77618bd803f", "name": "network-vif-unplugged", "status": "completed", "tag": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46"}]} {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:44:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-02191640-898b-490e-bbd0-bab72d047f03 req-3e32dfab-b12d-48c4-a4af-01298489b6ed service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:44:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-02191640-898b-490e-bbd0-bab72d047f03 req-3e32dfab-b12d-48c4-a4af-01298489b6ed service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:44:47 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [req-02191640-898b-490e-bbd0-bab72d047f03 req-3e32dfab-b12d-48c4-a4af-01298489b6ed service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:44:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.compute.server_external_events [req-02191640-898b-490e-bbd0-bab72d047f03 req-3e32dfab-b12d-48c4-a4af-01298489b6ed service nova] Creating event network-vif-unplugged:2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 for instance 7d939b5e-fb83-47fd-93ff-b77618bd803f on user Apr 13 19:44:47 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [req-02191640-898b-490e-bbd0-bab72d047f03 req-3e32dfab-b12d-48c4-a4af-01298489b6ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096455 Apr 13 19:44:47 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 387/1165] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:44:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:44:48 user devstack@n-api.service[61587]: DEBUG nova.api.openstack.wsgi [req-26031fdc-0693-4695-9c83-d641c2d3bdaf req-37b0cf58-ba8f-424f-b22b-330d0083b484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d939b5e-fb83-47fd-93ff-b77618bd803f", "name": "network-vif-deleted", "tag": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46"}]} {{(pid=61587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:44:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-26031fdc-0693-4695-9c83-d641c2d3bdaf req-37b0cf58-ba8f-424f-b22b-330d0083b484 service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:44:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-26031fdc-0693-4695-9c83-d641c2d3bdaf req-37b0cf58-ba8f-424f-b22b-330d0083b484 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:44:48 user devstack@n-api.service[61587]: DEBUG oslo_concurrency.lockutils [req-26031fdc-0693-4695-9c83-d641c2d3bdaf req-37b0cf58-ba8f-424f-b22b-330d0083b484 service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61587) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:44:48 user devstack@n-api.service[61587]: INFO nova.api.openstack.compute.server_external_events [req-26031fdc-0693-4695-9c83-d641c2d3bdaf req-37b0cf58-ba8f-424f-b22b-330d0083b484 service nova] Creating event network-vif-deleted:2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 for instance 7d939b5e-fb83-47fd-93ff-b77618bd803f on user Apr 13 19:44:48 user devstack@n-api.service[61587]: INFO nova.api.openstack.requestlog [req-26031fdc-0693-4695-9c83-d641c2d3bdaf req-37b0cf58-ba8f-424f-b22b-330d0083b484 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038525 Apr 13 19:44:48 user devstack@n-api.service[61587]: [pid: 61587|app: 0|req: 392/1166] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:44:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:44:49 user devstack@n-api.service[61589]: DEBUG nova.api.openstack.wsgi [req-7a740f3b-6991-4de2-90c6-4b1532f7baa0 req-c108aad2-a59d-4d35-bd83-b2221713cfac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d939b5e-fb83-47fd-93ff-b77618bd803f", "name": "network-vif-plugged", "status": "completed", "tag": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46"}]} {{(pid=61589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 19:44:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7a740f3b-6991-4de2-90c6-4b1532f7baa0 req-c108aad2-a59d-4d35-bd83-b2221713cfac service nova] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:44:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7a740f3b-6991-4de2-90c6-4b1532f7baa0 req-c108aad2-a59d-4d35-bd83-b2221713cfac service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:44:49 user devstack@n-api.service[61589]: DEBUG oslo_concurrency.lockutils [req-7a740f3b-6991-4de2-90c6-4b1532f7baa0 req-c108aad2-a59d-4d35-bd83-b2221713cfac service nova] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61589) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:44:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.compute.server_external_events [req-7a740f3b-6991-4de2-90c6-4b1532f7baa0 req-c108aad2-a59d-4d35-bd83-b2221713cfac service nova] Creating event network-vif-plugged:2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 for instance 7d939b5e-fb83-47fd-93ff-b77618bd803f on user Apr 13 19:44:49 user devstack@n-api.service[61589]: INFO nova.api.openstack.requestlog [req-7a740f3b-6991-4de2-90c6-4b1532f7baa0 req-c108aad2-a59d-4d35-bd83-b2221713cfac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028818 Apr 13 19:44:49 user devstack@n-api.service[61589]: [pid: 61589|app: 0|req: 388/1167] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 19:44:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 19:45:37 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_api:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:45:37 user devstack@n-api.service[61588]: DEBUG dbcounter [-] [61588] Writing DB stats nova_cell1:SELECT=2 {{(pid=61588) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 19:45:37 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a141394d-620d-433b-8d99-de8e82b0a785 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Calling method '>' {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 19:45:37 user devstack@n-api.service[61588]: DEBUG nova.compute.api [None req-a141394d-620d-433b-8d99-de8e82b0a785 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Fetching instance by UUID {{(pid=61588) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 19:45:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a141394d-620d-433b-8d99-de8e82b0a785 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:45:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a141394d-620d-433b-8d99-de8e82b0a785 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:45:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a141394d-620d-433b-8d99-de8e82b0a785 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:45:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a141394d-620d-433b-8d99-de8e82b0a785 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 19:45:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a141394d-620d-433b-8d99-de8e82b0a785 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 19:45:37 user devstack@n-api.service[61588]: DEBUG oslo_concurrency.lockutils [None req-a141394d-620d-433b-8d99-de8e82b0a785 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "1b3d0b3e-3b0c-432a-8f08-a7f7fa13671d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61588) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 19:45:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.wsgi [None req-a141394d-620d-433b-8d99-de8e82b0a785 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] HTTP exception thrown: Instance 7d939b5e-fb83-47fd-93ff-b77618bd803f could not be found. Apr 13 19:45:37 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a141394d-620d-433b-8d99-de8e82b0a785 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Request method failure captured: Apr 13 19:45:37 user devstack@n-api.service[61588]: request: GET /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f HTTP/1.1 Apr 13 19:45:37 user devstack@n-api.service[61588]: Accept: application/json Apr 13 19:45:37 user devstack@n-api.service[61588]: Accept-Encoding: identity Apr 13 19:45:37 user devstack@n-api.service[61588]: Connection: close Apr 13 19:45:37 user devstack@n-api.service[61588]: Content-Length: 0 Apr 13 19:45:37 user devstack@n-api.service[61588]: Content-Type: application/json Apr 13 19:45:37 user devstack@n-api.service[61588]: Host: 10.0.0.210 Apr 13 19:45:37 user devstack@n-api.service[61588]: Openstack-System-Scope: None Apr 13 19:45:37 user devstack@n-api.service[61588]: User-Agent: python-urllib3/1.26.15 Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Auth-Token: gAAAAABkOFs-u2a1B-44uzBrrDI3uSB4awVIOEigX60pEMQT9NEZNYZANOLEFMiD0tZyjB4QNe4tmHMKkPENYvhKjefWTtchRc49VrN4gvz49-LHtadxRBs-QLcfqKQWZj10_WkE0SUNq2pHuVqAxCPpxRwW_uED76WZZkkJ4VOslhT_tNGf1qs Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Domain-Id: None Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Domain-Name: None Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Identity-Status: Confirmed Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Is-Admin-Project: True Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Project-Domain-Id: default Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Project-Domain-Name: Default Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Project-Id: ee076581e18f48349a20be41e4634b72 Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Project-Name: tempest-VolumesNegativeTest-1091777559 Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Role: member,reader Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Roles: member,reader Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee076581e18f48349a20be41e4634b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ee076581e18f48349a20be41e4634b72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ee076581e18f48349a20be41e4634b72"}]}] Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Tenant: tempest-VolumesNegativeTest-1091777559 Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Tenant-Id: ee076581e18f48349a20be41e4634b72 Apr 13 19:45:37 user devstack@n-api.service[61588]: X-Tenant-Name: tempest-VolumesNegativeTest-1091777559 Apr 13 19:45:37 user devstack@n-api.service[61588]: X-User: tempest-VolumesNegativeTest-1091777559-project-member Apr 13 19:45:37 user devstack@n-api.service[61588]: X-User-Domain-Id: default Apr 13 19:45:37 user devstack@n-api.service[61588]: X-User-Domain-Name: Default Apr 13 19:45:37 user devstack@n-api.service[61588]: X-User-Id: 7cc805b367d6459f92d36f349737dc75 Apr 13 19:45:37 user devstack@n-api.service[61588]: X-User-Name: tempest-VolumesNegativeTest-1091777559-project-member Apr 13 19:45:37 user devstack@n-api.service[61588]: method: > Apr 13 19:45:37 user devstack@n-api.service[61588]: exception: Instance 7d939b5e-fb83-47fd-93ff-b77618bd803f could not be found. Apr 13 19:45:37 user devstack@n-api.service[61588]: action_args: {'id': '7d939b5e-fb83-47fd-93ff-b77618bd803f'} Apr 13 19:45:37 user devstack@n-api.service[61588]: {{(pid=61588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d939b5e-fb83-47fd-93ff-b77618bd803f could not be found. Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d939b5e-fb83-47fd-93ff-b77618bd803f could not be found. Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d939b5e-fb83-47fd-93ff-b77618bd803f could not be found. Apr 13 19:45:37 user devstack@n-api.service[61588]: ERROR nova.api.openstack.wsgi Apr 13 19:45:37 user devstack@n-api.service[61588]: DEBUG nova.api.openstack.wsgi [None req-a141394d-620d-433b-8d99-de8e82b0a785 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Returning 404 to user: Instance 7d939b5e-fb83-47fd-93ff-b77618bd803f could not be found. {{(pid=61588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 19:45:37 user devstack@n-api.service[61588]: INFO nova.api.openstack.requestlog [None req-a141394d-620d-433b-8d99-de8e82b0a785 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f" status: 404 len: 111 microversion: 2.1 time: 0.036457 Apr 13 19:45:37 user devstack@n-api.service[61588]: [pid: 61588|app: 0|req: 388/1168] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 19:45:37 2023] GET /compute/v2.1/servers/7d939b5e-fb83-47fd-93ff-b77618bd803f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)